YIKES...better get it out quick, thanks

I was going to tell you that it is Daucus carota but now I'm thinking that I shouldn't.

If you think it is not a pepper either move it or discard it. One definition of a weed is a plant that is growing where you don't want it. I would likely plant it in another area just to see what might develope. Maybe it is a weed or maybe it is some other plant that you will find interesting and a keeper. I've occasionally pampered a weed until it bloomed and I knew it wasn't a plant I wanted. Then I discarded it before it set seed. I've also done the same with some perennials that I have identified but find that I don't like so they are a weed to me and are traded or go into the compost pile.

I understand the need to get in some plants, but since you have possibly found a treasure trove of plants, resist the urge to do too much digging or removing of stuff you find, until next year's growing season. You may be pleasantly surprised by what the previous owners have already prepared for you, the new home owner. Since perennial bulb flowers are also notorious for a short blooming seasons or even ratchety leaves as they die down each year, even the old plants mixed in with your new lilies could be a great combination! Don't throw all the bulbs away until you have identified them. They could be a wonderful plant that you end up liking.