Just wondering if it's an interesting native plant or something that will take over if I leave it alone. It's both.

Very nice photos :o) I'm not good at identification with no books for reference but yes, #3 Garlic Mustard HAS TO GO... it is an EXTREMELY prolific alien invasive weed very difficult to control once it gets a foothold. This time of year it is easy to see from it's upright growth and flowers atop. Pull them from the lowest point possible. There is a "nub" at the base of the stem and if you get your fingers just below that nub the whole plant will come out roots and all. These things sew zillions of seeds so it's best to get them out now before the flowers go to seed. #4 & #27 are Jacks. Young jacks DO look like trilliums. #15 looks like very young jacks. #9 & #12 do look like Arrowood viburnum to me as well. #10 looked like false solomon's seal to me (thought I saw a flower bud at the distal end of the stalk. Did they flower underneath? #11 looks like a "cornus" (dogwood) species 14 is definitely real sololmon's seal by the flowers falling under the stalk. #19 and #22 both appear to be Sensitive Fern #26 Looks like plants I have in my window "Hawkweed". Mine are orange but there is also yellow. I like these very much but they aren't native here. I have them planted in the window boxes of my shed, in window planters on my house and in my front garden. #33. Wild violets as everyone else has said. Good luck with your identifications :o) Barb

Thank you everyone! I pulled them all. I planted around 30 plants and only about 6 have came up. I guess I will go out there and try and plant some more seed. Maybe the ground wasn't warm enough when I planted them, either that or maybe not a very good packet of seeds?

My best guess would have to be a Bird of Paradise. Most likely a white Bird of Paradise. I had a white one before, and it resembled your plant.