YES, I am aware of the irony in "complains about marvel movies and AAA videogames being subtle variations on a tired formula, while being a huge fan of mid-budget JRPGs which are practically DEFINED by their relationship to a formula"
NO, I have not been able to figure out why this is, exactly
my main theory is currently just "budget". i.e. western stuff is so goddamn expensive it can't afford to alienate anyone; the economics preclude doing anything interesting almost by definition. Japanese studios tend to operate in a budget range where all-things-to-everyone mass appeal is IMPOSSIBLE, so they're forced to get weird in order to find an audience. That's way too simple an answer though; there's def more going on
