Dex

Big hearted fluffdragon...

...fictional ex-90s platformer mascot, nerd, plural, Ξ˜Ξ”.


Masto 🐘
scalie.club/@Dex

Dex
@Dex

(strong bad voice) whoa, that is not a small number


Dex
@Dex

currently at about 2000 saved, 4GB

originally it was going oldest to newest, but then i had to restart the downloader and the restarted version is going newest to oldest, and is currently somewhere around january this year


Dex
@Dex

got to about 15,000 saved, 20+GB

decided at this point to move it to the NAS rather than laptop's hard drive

good: we no longer fear being banned from FA for the bulk download
bad: because it currently feels like it's going at a rate of 1 per 5 mins

(and to save you the trouble, 57,000 images * 5 mins = about 197 days)


Dex
@Dex

moved it from the NAS to a thumb drive; currently somewhere over 20K, 30GB

so far, there are 5152 accounts we've favourited at least one thing from, with the most frequent one so far being teaselbone... making it more surprising we've never commissioned them


Dex
@Dex

download mostly complete, beyond 1000-2000 that had some problems at the beginning due to a permissions issue running it on non-windows

some statistics:
10398 artists - 67 of which we've favourited over 100 things from
teaselbone is still the top artist with over 800 pieces of art favourited (there is a prolific commissioner ahead of them, and surprisingly it's not togepi)

4706 accounts we've apparently only favourited one thing from, though this may be affected by those 1000-2000 missing pieces


You must log in to comment.

in reply to @Dex's post:

the recent run on fa archiving has been interesting to see that there are much better tools for it out there

but also i've had a tool running for years downloading entire galleries and keeping them up to date built out of wget, bash, cron, and glue

i think the glue might be toxic since i think i'll just leave the system in place for now |3

honestly i did the same thing in powershell years ago as a one off but yeah, i don't think it would have coped well with our favourites gallery :v

also this does at least preserve titles and tags