This is a comment article on Welchman and Goncalves (2017): ‘‘What not’’ detectors help the brain see in depth. Curr. Biol. 27, 1403–1412.