What a charming house. I love the green around the windows, so I would not change that. The yellow in the picture is so light it looks white, but I can see spots where it is definitely yellow. How about a two tone of gray?

I wouldn’t be quick to remove the bushes/trees/shrubs! Identify them first — they may just need pruning and shaping. What are they? The one on the right looks like a lush weeping tree of some kind that has been pruned to look like ‘cousin It’. :) Your house looks great in the color it is now!

I agree with cat_ky that the house appears to be stained. The color very well ties together your brick and your stone chimneys as well as your brown roof. Your landscaping is also nice. I would put more money into extending the planting beds even more. Get a professional designer to help you do that (and hide your HVAC compressors in back.) Here are multiple Houzz photos of home like yours. Step back from the front of the house quite a bit so we can see the whole setting. It's possible a beautiful stone walkway and a painted entrance doorway would enhance your already wonderful house. What's wrong with it?

I'd go a nice crisp white and redo the landscaping with lots of lush greenery. Black door. Remove the shutters. White railing in front and maybe add thicker, square columns on the porch.