You need to bag the fruits or somehow protect them from the 'critters' until they ripen. Otherwise, just remove the fruits (or flowers!) when they are small to prevent the mess.

Dave, I'd say it was planted. There are a few of these around the yard (3) & they are alone where they are.

It wouldn't let me upload these last night!

People may wonder what you are up to when you appear to be staring at their house. Even then after perhaps hundreds of hours of walking or driving around looking at trees and plantings on local properties I have been questioned maybe twice at most. By people that happened to be outside, looking back as I passed by.