I don't know about the tuber portion but the leaf looks like common wandering jew. Is this widespread? Did you plant anything new that went to flower and seeded? Could it be from what you might have mulched the beds with?

It looks like Tipularia discolor, a native orchid, also called cranefly orchid. The leaf is green, or green and burgundy above, and burgundy below. You probably always had it. It has a leaf only in winter, then a flower stalk with no leaf in summer. Shame to throw them away. Many native plant enthusiasts would transplant them, although they are not rare.

Thanks Brenda. That was a fast i.d.!

Yes, it is a cranefly, and yes, many people would love to have it. Don't know where you are, but the NC Native Plant Society may have someone in your area who will come and get them. Email tom@ncwildflower.org and tell him where you are to see if anyone lives near you and would want them. I have many in my woods, and they do form colonies after a while. Similar is puttyroot (Aplectrum hyemale) with pleated leaf, no maroon, but the same "leaf in the winter, bloom stalk in the summer" growth habit, and IS considered somewhat rare ... also used by some wildcrafters as medicinal and edible plants. Guess this just goes to show you that a weed is just a plant with an unhappy owner.

You know, I knew there was SOME reason I thought of posting that on here, have never thought to do it for any other "weed" but there was just something strange about this one that was nagging me, so glad I asked!
Thank you everyone for your help and my pulling stops today! (unless it's to transplant them!) So, what type of flower stalk should I be on the look out for now?

They are not real showy, so you may want to move them to a natural area. They take pure clay soil for me, and putting lots of them together in a patch gives me a little show even though individual flower stalks are not bold. I actually like the leaf - it's pretty and one of the few "live" things in my natural area in these months.

Oh, I've seen those before in the woods and wondered what they are. I always thought the leaves looked nice. I've never seen the blooms before. Maybe not showy but kinda cool looking. I'll have to scour my more natural areas to see if I have any hiding there.
NCrescue, I like your quote about weeds and unhappy owners. I have to say, I'm VERY unhappy about my stilt grass. I think I can safely call that one a weed :) -Ais.

One picture doesn't do it justice, so here is a link to a page of google images for Tipularia discolor.

Here is a link that might be useful: Tipularia images

i love crane's fly orchids and transplanted some just to have the beet red/silvery leaf in winter before i ever knew what they were. they are fun. glad you had a change of heart, twisted! ais, i heartily second your assesment of #@$%(*& stilt grass. ugh!! tam