That’s true, I noticed on a couple subreddits that votes don’t matter unless you’re mildly popular, and it’s even possible to get comments throttled for being unpopular enough. Downvotes don’t do much besides pushing your comments off the screen for the most part.