Congratulations on your home! I would lean into the brown of your roof and grout. Remove all of your shutters and paint your siding, trim and garage door Urbane Brown, a dark tone that will unify the parts. You could consider an orange, or bittersweet colored front door to brighten up the area. But one color to tie all together. Do not paint your brick!

brick is fine.

what I'd do is change out the siding on that 2nd story and remove the shutters

lousy photo shop, but kind of gives you an idea.

you could do a type of batten siding up top, or a vertical siding, and consider painting it a darker color, but in a warmer tone that still works w/the brick and the roof color

here's a vertical siding (look at James Hardie siding) w/dark trimmed windows, no shutters, cedar posts, dark garage door, updated lighting

another one w/vertical siding, no shutters, dark garage doors...landscape of course

Here are some color combos to consider w/the yellow/orange brick.

bronze, copper, warm wood tones, bronze metallic lights, copper rain gutters, all look nice

If you want to stay w/warmer colors.

Pair it w/copper accents and front door

Another darker color that looks nice w/these copper tones, Urbane Bronze or Iron Ore.

Here are a few pics of some updated split levels.

this one has the smae brick color and they paired it w/a deep navy.

look for blueish charcoals like this one (Cypberspace is similar) Stone Lion is a close beige match

Obviously this is more than just paint. thought I'd show it so you can see possiblities. this is a beautiful remodel.

Not quite as drastic. new siding/paint. dark door, new front door and no shutters.

If you ever decide to consider doing the brick, Romabio is a Lime product that is natural, requires no maintenance and comes in either a limewash in 7 diff shades, or a Mortar coverage that can be tinted any color.

Just showing you an example of a house that was done in a heavier lime wash, metal porch overhang and similar brown roof. copper color rain gutters. soft gray garage/shutters.

Sorry for the duplicate response. I am having issues with Houzz. The color I recommend is SW: Urbane Bronze. You can Samplize it to get an idea of how it might work.