Would an ultrasonic pest deterrent impact bees at all?

Beekeeping - Basics
2

Yes it will affect the bees.

Wasps, spiders, beetles and bees have “chordontonal” or tympanic membranes that sense ultrasonic vibrations