Much easier to ID when flowers are present.

2nd picture looks like peony.

3rd one is a mixture of stuff.

You should get more helpful responses on the Name that Plant forum. There are some real ID whizzes there. You can just copy and paste your original post, photos and text, to the new spot.

i am not sure what the plant is in the upper right of the first photo, but the one in the center with ferny leaves that is also behind the peony is most likely one of the weedier Artemisia. Does it have an herby scent when a leaf is torn? Regardless, it looks too aggressive to get along well with other plants, so I would start working to remove it. Anything growing near the peony or hosta needs to be removed, and at a time when you expect to have a few days of cool rainy weather or else this fall I would move the Hosta so it is a bit farther from the masonry since it looks like it will be too close.

The shiny leafed groundcover in the last photo looks like it spreads fairly aggressively as well, so I would likely pot up a few to confirm ID when it blooms and remove the rest before it takes over everything unless you want an aggressive groundcover there. Right now it makes me think of Campanula punctata (such as Cherry Bells) which is a rampant spreader to the point of extreme weediness in many gardens. I am generally a fan of Campanulas though my soil is too acid for them to be entirely happy, but C. punctata is far too aggressive for me.