small bug who learned to use computers and is evil. 63


modulusshift
@modulusshift

Here's an update on how that Reddit AMA on the API pricing is going, hid below read more for the benefit of those who don't care lol


vogon
@vogon

the line everyone is feeding people about LLM developers using APIs to ingest text from different places to justify API price hikes1 is bullshit, by the way. not only does the ridiculous size of modern LLMs mean that there are really only a handful of hosted LLM platforms, which each consume a trivial number of API requests per thread -- but also, none of them are writing their own custom scrapers that use reddit's API, they're just scraping it as a web page.

the only light it makes any kind of sense in is "since people are consuming our web site through LLMs, we need to make up for the ad revenue we're losing by nobody actually looking at our web site" -- which, coincidentally, is a line the web industry never seems to have any time for when it comes from, say, the newspaper industry.


  1. which twitter also trotted out a few months ago


You must log in to comment.

in reply to @modulusshift's post:

yeah, Sam Altman was formerly the CEO of Y Combinator, a Silicon Valley-area startup incubator1 that Reddit graduated from back in the 2000s.


  1. for anyone unfamiliar with the concept, startup incubators are very early-stage venture capitalists that give you a few months worth of funding to make a demo, in exchange for a big slice of ownership in your company.

i think that 20 million figure for apollo is probably like... the amortized cost of all hosted requests via the api coming from apollo. so that's just... the infra spend for the (large!) proportion of users that use third party apps. that's literally the opposite of a reason to turn it off, what dumbass would even imagine that it would somehow cost them less to host all that traffic themselves? all of this bullshit and whinging is completely orthogonal to actually reducing costs. they are just cutting their user base loose lmao

so we're comparing what spez says 3rd party apps cost reddit every year to the estimate Christian put together based on the announced pricing for how much Apollo would be billed by reddit each year.

and I dunno, I mean a lot of that work is already duplicated right?

but generally I agree, there's very little point to this

yeah like if all they have to spice things up for investors is "um we're gonna totalize the UX into our own app even though it's dogshit and everyone hates it, that way we will um. impressions" i can't help but think there's a serious lack of imagination and overall acumen here

e: i mean ok that's before you look at the general history and context of spez's behavior to confirm the impression entirely but yeah

plus, i mean... if ad revenue were really the problem (i think it's clear here that none of this is about the actual money they just want to completely control everything and could give a fuck about anything else)... if that were the problem they could just update the api to serve ads alongside the posts. but they didn't

in reply to @vogon's post:

isnt this what API keys are for. Like. Do they not know which apps are using which keys? even twitter requires you to sign up and give reason.

do they have no ability to see someone using that many API requests, google their app name, and see if it's for LLM digestion? Are they run by clowns??

sure is! only real argument against using API keys for this is that people can create burners, but even then you can still detect one entity cycling through a hundred different supposedly unrelated API keys just as easily as you can detect them using one to make 100x as many requests