It’s not as personal as that. Down voting just means that the post/comment will be further down if you’re sorting by ‘top’. The more upvotes the closer that thing will be to the top of the page. It’s not just for you, it’s for everyone. If that makes sense?