My husband is a bow hunter and unlike rifle where you can shoot from really far away, bow hunting (obviously) requires you to be much closer to the animal and have a VERY clear shot. It is highly unlikely that anyone that close would mistake a human for a deer/moose whatever.

Besides, just make a lot of noise while caching and you'll scare both hunter and hunted away!