Humans tend to find it strange that cats will often suddenly stop and stare in unusual directions, seemingly looking at nothing at all. What humans don't understand is that the cat is in fact not looking, but listening; the cat has heard something, and is turning its head so its ears are cupped in the direction of the sound.
Implication: If elves were real, they would often as a group swiftly turn their heads to apparently stare at nothing at all, swiveling their ears slightly as they do so
We humans tend to do a similar thing but we don't realize it because it's "natural" for us... until someone else points out that you were spacing out. So who are we to judge, really?