If you have a shady spot where nothing else will grow, I'd suggest moving rather than discarding the wineberry. I think they're quite delicious, and they're incredibly easy to grow. I planted mine a couple of years ago on the north side of my two-story house -- at most, they get an hour of early morning sun and an hour of late afternoon sun. Nonetheless, they've grown and spread prolifically (they'll tip root if you let them), and are producing a very large crop this spring. For me, they're the ideal worry free fruiting plant -- no insect or disease problems to speak of, birds don't seem to bother them so I don't have to put up netting, they require very little sun to thrive, and they're reasonably drought tolerant once established.

It looks like Winterberry Holly, Ilex verticillata. That's not backed up by any evidence except that's what it looks like to me and I would expect it to be fairly common in NY state. They are largish, forest understory shrubs. WW Here is a link that might be useful: Winterberry holly

I think chickens know what not to eat but nightshade is very toxic to people. When this weed pops up in my yard, I send it and all it's berries right to the garbage. Min

If it's the same Georgian Bay I know, it's the northeast part of Lake Huron in Ontario...east of Tobermory and Manitoulin Island.