Keep the stone as is and paint the siding and trim. It's the high contrast that's the issue.

I agree with Beverly, leave the stone alone. It is fairly nice looking. Do not ruin it by painting it. It is the contrasting paint color that needs to be redone. Choose a paint color from the stone itself, so it all goes together. Whats on there, definitely does not work.

My contractor tried to "fix it" and made it worse lol. Did not want to repaint the whole house but may need to

Painting the garage door helped. No need for more paint, just plant some shrubbery in front of the house. It will make the house more integrated in the natural landcape and soften the high contrast between land and the white of the house, while also fixing the proportion. If you dont have time/budget to plant you can just place the shrubbery there in their nursery pots(optional wrap them in burlap).

I agree it looks better and a touch of shrubbery from the nursery would be great, and pay for full attractive plants. Don’t skimp. Personally I would remove the shutters, but ask your realtor. I’d also paint the front door, I think and get a lovely porch light— but none of it matters ss much as everything being spotlessly clean and minor repairs taken care of. It is an unusual house so your likely buyer will be more concerned about other things than cosmetics