Poke, Phytolacca americana.

Thanks Dzitmoidonc, I pulled them all this morning, roots and all. I had never seen this plant in my area though guides say it does exist here. Birds must have brought the seeds in or it could have been in some of the topsoil I bought.

Pokeweed/poke berry is a native plant that provides berries for birds. The berries ripen at different times meaning it provides berries over a long period of time. If memory serves, it is one of the few plants that continue to flower while it is already producing berries.

I can understand not wanting it in a more formal landscape, but I think it has a place in a more wild area. I'm growing it in my restoration project. It is great in a hedgerow.