There are very few unethical bow hunters and a long shot is 40 yards, most shots even closer then that. When I bow hunt, you could walk right under a tree I'm in and you'd never know I was there unless I wanted you to know.
But during the "silly season", i.e., the regular rifle season on deer in November, wear your orange and stay clear of places that attract large groups of hunters. I do deer hunt during that season, but I try to "get it over" as quickly as possible. Normal law-abiding people turn in outlaws during this season, and crazy people... well throw away the keys! I'd simply stay clear of common hunting areas in November.