mink

i am wascie wisses

animator × writer x animal murdered for its fur
~
Deaf mink making a video game stageplay about a dead milf

discord: wascie



mink
@mink

something i tussled about endlessly in earlier dev stuff this year was how to visually represent sign language usage in my sprites or if i even could. the two main characters' family is [Culturally Deaf] and though Tippy is hearing and can operate in an oral and hearing world, Dewdrop ain't. For a character, The Main Guy no less, who exclusively communicates in his woodland critter sign language, I was like.

how'm I gonna handle that when it comes to sprites? it's complicated!!! and gave me a lot of ponders.


LotteMakesStuff
@LotteMakesStuff

THANKS FOR BRINGING UP SIGNING IN VIDEOGAMES! IT WAS A COOL WRITEUP, its super cool seeing someone thinking about how to implement that in a 2D context. ANYWAYS A SIGN OF AFFECTION IS AN INCREDIBLE MANGA AND ITS DEFFO WORTH LOOKING AT IF YOU INTERESTED IN THIS KIND OF THING.

"A Sign of Affection" is a romance manga written by suu Morishita about a young deaf college student falling in love with a slightly older student who is a bit of a globetrotting polyglot weirdo. Yuki is pretty much fully deaf, she has a hearing aid but it cant help her hear speech at all, but she can sign and lipread, WHICH IS SUPER NEAT because we have a SUPER complicated set of text rendering requirements in this manga.

In any other shoujo manga you might just have characters talking in japanese, and that it. Maybe the artist needs to figure out a way to depict text being read from an out of sight phone screen or something. Maybe you throw in an internal monologue, and thats kinda it. Maybe three different text rendering styles.

For this... heck, they had to figure out how to depict spoken word japanese and internal monologue. Standard. Then the boyfriend speaks at least 3 languages, and sometimes is depicted talking in non japanese languages. A bit more complicated. Then theres reading from phone screens and handwriting on paper... with multiple characters having ongoing conversations in a written medium... heck! Then theres sign language, which is mostly handled with "hero poses" with more well known signs.. and sometimes not.. sometimes we have two characters just signing at each other, how to you handle that in like, 5 panels? Then theres the lipreading... and all of this has to be seamlessly integrated smoothly onto a single page.

The lip reading has a particularly fascinating implementation in this manga, it manages to super elegantly render not only just normal, correct readings of a characters speech but also misreadings - sometimes yuki just plain gets it wrong, which can lead to confusion or missed communication. Sometimes letters are jumbled or rotated indicating totally garbled unreadable mouth shapes (maybe due to someone speaking too fast). Sometimes it even handles mouth occlusions, breaking off readability half way though a sentence due to visual obstruction. Like, that's a LOT of meaning being expressed AND state being embedded in the text! Its deffo worth reading if you wanna see how similar problems are tackled in a completely different media. An anime adaption is going to be aired early next year too, will be very interesting to see how the same set of requirements are approached for TV


mink
@mink

ohhhh shiiiit. thanks for springboarding off my post cuz i am obviously always on the lookout for any media about deaf experiences so it was a welcome throw. I read a gayboy manhwa called sign recently that is just like, Strictly Okay and left me just feeling shrugged on the Deafguy Experience front, but this sounds wayyyy more up my alley and super cool. THANK YOU

There's actually a lot of what you're pointing out here in my game too, which makes me excited to read it. My everyday life of trying to communicate across boundaries like this is like a really important part of the in-person experience that so much stuff just glosses over or doesn't know what to do about


You must log in to comment.

in reply to @mink's post:

good writeup! it makes me think of when the anime for ranking of kings first came out i was very interested to see how boji would communicate throughout the show. at the start it appeared deliberate and expressive (for me, someone who can't sign anyway) but its a shame he basically got a magic translator right away that sidesteps his deafness.

YESSSSSSSSSS OMFGGGG YOU LIKE. Get it. That was actually a huge sadness for me because the signing was beautiful and they had a woman who knew JSL working on it and I was so fucking upset that they just ended up pulling a "its too hard to have a deaf character and communicate with other characters" bit. It was actually a huge inspiration for me being like no I'm going all the way as hell

I like your approach, especially your point about how stiff hearing people come off as. One extra thought I had is that it might be viable to use SignWriting to provide captions or even just an indication of “linguisticness” to the sprites when they are signing.

Signwriting is so cool!!! I actually did consider if i should integrate it or not, or whether i should use it to develop documentation for the conlang of the sign language they use in my story, if i ever have the time... Plus on the more realistically economical front, I figured if the story can be told in english, it could be signed in ASL too, and the audience can just accept that it's a "translation" of the in universe languages. Sort of like book of the new sun's situation. Either way, after release at some point, I really would love to have an update where you can swap the signing to be either in english or signwriting of ASL

I'm not deaf or Deaf, but I think the usage of non-manual markers is the way to go for devs on a budget. I've taken ASL as a secondary language, and while I've forgotten a lot of it one of the things I really remember is how freeform it can be outside of the known signs and handshapes with specified meanings. Kind of like how animal crossing's animalese isn't quite english, just enough to sort of get the gist and feel like it, using exaggerated movements and facial expressions as a visual language feels like "getting the gist" of ASL to me.

As often is the case, designing with accessibility and representation in mind improves things for more than just the intended crowd. Having more expressive characters is something everyone can appreciate, whether they're deaf or hearing. I've played plenty of games where characters express little to no emotion. RPG fans know there are plenty of games out there where all you get is a little box with a stoic face the whole game.

While it would be cool to see a game with full accurate hand signing, I feel like art and budget wise it would be the kind of game that would dedicate itself towards that concept entirely unless it was working with a massive budget. We have to find creative ways to improve Deaf representation in gaming with reasonable budgetary accommodations.

in reply to @mink's post:

(STARES AS ANOTHER DEAF PERSON) YOU. DEAF GAME DEV AND ANIMATOR. HELLO i love your insights on implementing signing sprites in a game as i've had similar thoughts but never fully written them down! this certainly looks like a great compromise and i'm excited to see what you do with the game when it's published!