There is no ideal rating system, some other can tell opposite.
I have opposite thinking.
When you got 100 upvotes in first 12 hours and 1-5 after it is low likely that it will influence on rating top posts. I did not do investigations it is what i think i see.