Hi. I have a nice slender shrub growing under my peach tree. It dies off each year to its standing stalks, and branches appear from the top down.

It has two main stalks, about four feet tall. I was afraid it might be a tree but it's been in my garden for three or four years and seems to have hit its height. It's really pretty but I don't know what it is.

There are also several stands of grass or a grass-like plant popping up here and there. It is green with thin purple vertical stripes on its base.

It's kind of pretty in isolated clumps but I'm afraid it might take over my garden.

The first pic shows both the shrub and the grass clumps for perspective. Closer shots of each follow.

I'm not sure if the last pic is the same grass or some kind of flower. Maybe a flag?

Any help would be greatly appreciated. Thanks.

Image link: