i think i'm having the same problem with Starfield that i did with Pokemon Scarlet, which boils down to like... presentation of encounters affecting my willingness to engage with them?
there's a huge psychological difference (to me) between "you're walking along and suddenly you stumble upon a generic dungeon" and "there's a generic dungeon over there". in the same way, there's a huge difference between "you stumble upon a pokemon" and "you see a pokemon you can choose to go fight".
if you just give me the thing, i'm more receptive to it than if you first ask if i want the thing, even if the thing itself is no different.