I would not paint the brick. The brick is what makes your house stand out and I do not like grays or blues with brick.Do the siding the same as the window trim and you could do the garage door the same . Then go to work with landscaping that will up the MCM look much more than paunting the brick.

Keep the garage door neutral like the foundation but add a garage pergola above it and grow a climbing vine to run on it where the pine gets removed. You can paint vinyl siding. Sherwin Williams has specialty paint for that. I would paint the dormer (and downspouts) to match the roof color, paint the shutters white, remove shutters from lower windows and paint their trim the same white as the shutters upstairs. Take care of the landscaping as mentioned above. Looks like you need to increase/upgrade outdoor lighting and beef up the weenie railing. Maybe a local iron worker could enhance it with some interesting trim. I would also consider a new look for the front door; probably a single glass storm if your climate requires it. Black would make for a nice front door and storm on your brick home.

There is a large camp of no shutter people on Houzz. If they don't function or are not as large as they should be to function - get rid of them. I sometimes agree, and sometimes feel like the shutters add color and interest and are there purely for decorative reason, and this is perfectly okay. Your description of Victorian Inspired is also fine. It is not a Gothic (Think Haunted House) or Queen Anne Victorian, but it has the general shape and feel of a Victorian home, which is why you used the word "inspired." "Queen Anne homes are the quintessential Victorian home: They are asymmetrical, two or three (or more) stories tall, have steeply pitched roofs and large wrap-around porches. They are often adorned with differing wall textures and ornate trim—which gives them the “gingerbread” effect commonly associated with Victorian homes—that is typically painted in a variety of accent colors. Some Queen Anne homes also have octagonal towers (topped with a round pointed roof) and ornate bay windows—in short, nothing about these homes is subtle." Not all Victorians are the quintessential Victorian. Here is one that was featured in Architectural Digest. If all you want to do is change the color of the shutters, door and garage door and you found something that you think is beautiful a few blocks away, I would go knock on their door and ask what colors they used. My experience is that people are truly flattered when you knock on their door and ask something about their color choices or landscape choices. I have ended up in long conversations and even been given home and garden tours by doing this. I have gotten plant cuttings and been given samples of paint when the label was unreadable. I have never been turned away or scolded for admiring someone's home.

I would attempt to select colour from the stone in the body of the garage or house to de-emphasise garage doors. They are much more the focus now, than the main front door. At another time, I would paint all the trim a darker colour from the same Hue Family neighbourhood and choose a bolder contrasting front door colour to draw your eye to the main entrance. ( A much larger light or multiple directional lighting in the porch would help too) Example,