ceargaest

[tʃæɑ̯rˠɣæːst]

linguist & software engineer in Lenapehoking; jewish ancom trans woman.

since twitter's burning gonna try bringing my posts about language stuff and losing my shit over star wars and such here - hi!


username etymology
bosworthtoller.com/5952

winnie-the-pooh
@winnie-the-pooh

And the dream began to sing itself over in his head until it became a sort of song. It was an

Anxious Pooh Song.

3 Cheers for Pooh!
(For Who?)
For Pooh—
(Why what did he do?)
I thought you knew;
He saved his friend from a wetting!
3 Cheers for Bear!
(For where?)
For Bear—
He couldn’t swim,
But he rescued him!
(He rescued who?)
Oh, listen, do!
I am talking of Pooh—
(Of who?)
Of Pooh!
(I'm sorry I keep forgetting.)



eramdam
@eramdam

This is very good advice BUT, and this isn't a dig against OP, just a heads-up. A lot of AI companies will either straight up ignore robots.txt or will fake the user-agent of their crawling bot to bypass any blocking you might do on the server-side.

This isn't the only source but is one I could easily find about this specific issue:

I wish there was a silver bullet for that stuff but alas.