back when I was newer and would follow all the good, insightful posters I came across, I ran into a problem of that leading to an overwhelming amount of discourse and meta-talk and, yes, drama, in my feed. it dominated the length of my feed and was tiring to even scroll past when I wasn't in the mood for it -- even if art and specific interest posts were more frequent. largely because those posts would be long and shared often when the discourse spiked.
it didn't feel like I was doing anything "wrong," but using the site made me anxious, and I thought it was the site itself. then I realized that "following all the best posters" is not automatically a good way to do things, which felt counterintuitive at the time. so I unfollowed several of them, not because they are anything but good, insightful posters -- but because a feed is more than the sum of its parts.
so the way I think about it now is that following or unfollowing someone is not really about them specifically (not always at least!), but about how that cultivates my existing feed.
I've since refollowed some of the people I unfollowed, now that I've been on the site enough to follow a lot more accounts that are heavy in art, games, queer talk, special interest and have figured out which tags to muffle to shape my feed better.