Mike.... Try using vinegar at every watering along with a weak solution of fertilizer combined . One capful of vinegar per gallon of water. That should do the trick within weeks if not days:-) Mike

Sorry to post so late to this topic. I just found this place and created an ID just to answer this LOL. It is definately a mullberry tree. I am assuming the berries are white and look a little like strawberries? I have one and I get tons os Cedar Waxwings as well as Baltimoe Orioles and Robins. They eat the fruit until it is completely gone. The Mullberry tree is considered a weed to most but I love my tree. It is right near my porch and I spend a couple of hours every day watching the birds enjoying the fruit. The only downfall is that the berries fall off the tree and can make a mess. To me it is worth the inconvenience though. Mullberry is a favorite for many birds and if you have one in your yard the birds will be there from morning to night.

Thanks carol23_gw, it sure looked like a fruit to me, but it all makes sense now that I know it's a gall. I will have to go back and look closer to see if there are any galls left hanging in the trees, it should be easier to spot now that the leaves are thinning out.

No they all fruit at some point. The problem you have here is you are showing sprouting stumps, without even adult habit and foliage present - let alone flowers or fruits - hoping somebody can tell what kind of shrub* it is. Since Punica has been suggested (I thought of that also) if you have another still present on the property you should be able to clip shoots off of this one, hold those up next to similar growths on the other and see if they look the same. *A medium sized tree is one say, 35-60 ft. tall