it is clear to me that no mechanical change to social media will reduce the toxicity. people will always try: they've tried changing the algorithm, using "AI", changing the gamification... and it doesn't work
and it doesn't work because there's only one real answer and it's an answer none of the people running these sites want to hear. you just have to ban the people who cause trouble. there's people out there who simply want to cause trouble, hurt people, and fuck things up, and they will stop at nothing to do it. no mechanic will get in their way because they will try their best to work around it.
...Jack Dorsey's run as CEO of twitter was characterised by this ignorant sense of optimism that everyone on the site was interested in approaching it with good faith and posting only the truth, and he seemed to believe that the only reason "bad" posts would appear is because someone with good in their heart had simply been misled, or misunderstood the site's rules.
...this eventually lead to him, in his ignorance, once the toxic posts started coming without end, to assume that the neo-nazi point of view was "winning" in the public sphere because it was the viewpoint that was argued the best. "if you disagree with it," he would say, "why don't you make a counter-argument?" but it doesn't work that way, because trolls on the internet, as I already said, don't like rationality. they don't like arguing. they like to come in and destroy things and the thing that pisses them off most is barriers that stand between them and destruction. they don't want to make friends and they don't want to help the site run smoothly. and if a site admin doesn't get that, then I just assume they're probably one of them
Banning users for unacceptable speech requires you, a platform owner, to hold and publicly state values with regards to what things are unacceptable to say. Even the most libertarian-right freezepeachers have speech they won't tolerate - say, posting a photo of their home address with your current GPS coordinates a few blocks away and a gun sitting next to it - and it's adorable to watch them pretend they don't.
The reason they are so reticent to do this, though, is that they see it as being pure downside. If you state your values, people will criticize you where their values differ. You'll lose customers, beyond just the people you had to ban. Capital Brain tells you that losing customers is always bad, even if those customers are driving away other customers and making everyone miserable. You lose the safety of being able to pretend that you are "apolitical" and above it all. You're down in the muck with the rest of the human race, in the messy eternal squabble over what kind of world we actually want to live in - a domain where technology can almost never solve social problems, not really.
So that's why you couldn't hardly torture a moral stance of any clarity out of Jack Dorsey. That's why Steam's user culture was overflowing with white supremacy for years. The unbearable, unavoidably accountable daylight of saying they believe some ideas are good and other ideas are bad, sizzling the vampire's flesh.
Another factor here is pretending that a software-enforced ban is the only way someone can be pushed off social media.
Because it's true in the technically literal sense that you can post on a site where everyone treats you with maximum cruelty at all times. If every time you log on, you're confronted with huge crowds of accounts--more than you could ever block--saying the most disgusting imaginable things about you, implying that you do horrible things to children, that your body is so repugnant as to be comical, and whatever comes within a TOS's breadth of saying someone oughta do something about you... the post button still works! You have not been banned!
But at some point... really? Haven't you?
If a swimming pool is unlocked, but full of piranhas, is it actually available to you? Because it's not locked! The only thing holding you back is your own pain tolerance, medical budget, and fear of death--but those are you problems, those aren't hard barriers! And a few people are in fact foolish or tough or armored enough to swim in the piranha pool, so see? You're totally not banned from the pool!
If some of your users have to exercise tremendously more moral fortitude than others in order to participate in your social media site, you are fucking kidding yourself if you think everyone has equal access to it. You're just allowing the decision to be made by piranhas instead of moderators.
Also, while I'm belaboring this metaphor--it doesn't do any good to tell people to just jump in there and start biting the piranhas back. Apart from the fact that this would still not be fun, it just isn't a symmetrical situation.
You're not going to be able to make someone feel truly, deeply hurt and afraid over being white or straight or able-bodied. You're not going to be able to rally bomb threats against a Christian school just by saying "they're trying to make kids Christian." You're not going to keep a cis man up all night worrying that someone will send his parents pictures of him wearing men's clothing. There are weapons that are simply not available to "both sides."
Pretending that all attacks are equally harmful and thereby equally harmless, and I put up with being called a cracker so why shouldn't you put up with _________, is... it's not even an interesting logical fallacy. It's just total wank.
