Since we only live an hour from the Canadian border, I'm always looking for caches in Quebec. There are a lot in the Sherbrooke area, but that would be an overnighter we haven't got around to yet. But I've noticed that there are a LOT ofd new caches in the Woburn/Megantic area, which can be done on a day trip from central Maine. Quebec is a lot of fun - many Quebecois speak English (especially in the southern part) - and I encourage you to try it.
Here's a link to the southernmost cache: