What use is seeing behind yourself to a creature that often lives in tight tunnels.

Whereas cows and horses and such live out in the open, seeing predators from any angle is important.

A mouse and most other rodents, pop their head out from cover, then look around a bit. So binocular vision is more useful and thus favored.

Also, some rodents are predatory.