Actually... Yes! LOL!
I don't now anything about nut allergies, and don't know what nuts might bring on an allergic reaction, but here in Maine I often see Butternut trees - especially near old farmsteads. And the ditches along Maine's logging roads are a great place to find Hazelnuts. We also have Beech Nuts, and I note that this seems to be a very good year from them. I don't recall seeing Hickory nuts here in Maine, but I know you have them down there in Mass, so they might be in southern Maine.