Juniper

That's not an ugly shrub. That's a beautiful shrub that some ugly gardener has butchered in a very ugly way.

Junipers are misused, mistreated and maligned. Sometimes even misquoted.

They are durable plants that ask little for doing a job well done. Because they have been used so commonly in such inappropriate ways, many gardeners have a tendency to dismiss them.

But just as the dog training books states, "There Are No Bad Dogs -- Only Bad Dog Owners", the fact is "There are no Ugly Shrubs -- Only Bad Gardeners Who Put Shrubs in the Wrong Place [and mistreat them]".

Joe

What to do with that one is pull it out of the ground and start over, although some birds eat the berries.

While the neighbor's shrub produced fruit , your plant may well be a male which will not produce any.
Junipers, like hollies, are dioecious.

FYI, you can use the berries for cooking if the scent of them tickles your fancy- just use two or just one of them at a time, never any more, as that can be poisonous. They're okay in very tiny amounts. ;)