Your current shutter color would also work on your door. This brick home shows Benjamin Moore's Tarrytown Green on the door and shutters. It's a particularly nice green with the brick. Maybe not what you're looking for, but this brick home with the black shutters and white trim looks classic to me.

This isn't what I am suggesting for your home. It is an excellent example of what I think you are expressing in the above post regarding the "friend" to the main house. In this case the materials vary and the colors are different but are connected with the window trim (red) and the board and batten gable end as well as the friend house being board and batten. BTW, this is one of my favorites here on houzz. I happen to love these colors, but I don't think it would work with your home. But the concept is beautiful. I like what Beverly suggests as the color combos for your home - white and gray. Or possibly you could go with a yellow and gray.

The stone gives your home a casual country feel, so the rigid and formal hedges look very out of place. I would pull those out and install a more open and airy landscape using lots of native perennials that will thrive in your locale but not become invasive. The concrete planters are also of a different era than your country home, so remove them. Consider installing some landscape lights that highlight the stone. And since the stone is so massive, I would remove the little arch details on your porch posts and beef up the posts themselves so they have adequate visual heft to stand beside the massive stone wall and look like they can support your porch. Are you replacing the roof or cleaning it? I would take care of that before choosing a siding color, and I vote to remove the shutters. You should probably upgrade the porch lighting too.

I would pick the darkest color brick in the building next to you and use that color. It appears to be a darker gray color. That would look really nice with your black door. You can pick up paint samples at the paint store and try them against the brick. Actually, any color in the brick next door would work on your townhouse. I am not in favor of painting the brick. I lived through the 70’s. Lots of people painted the brick in order to modernize the house. You have expensive brick on your facade. It’s beautiful!