How high up is it and how close is it to other structures? I think one of the best things you can do is never walk up to it anymore....which leaves your scent. But answer my other questions and I might think of other possibilities. I just had a carolina wren nest on a table on my porch (in a pot, in a tub) destroyed by a feral cat. :(

It's about 4 - 4 1/2 feet off the ground. The closest structure is our house, which at it's closest point is 12 feet away. No feral cats around, but we are close to woodlands - so foxes, deer, raccoons, and snakes. Vaseline the pole? And of course - other birds.

I don't think you have too much to worry about.......but I have seen red squirrels and gray squirrels climb poles. You could try oiling the pole. Out here in the country, we don't worry about looks too much. We'd probably put a temporary fence around it. haha