I'm sure others will chime in, but it sounds like a lot of colors to me, with no particular focal point. Is there a reason why you're keeping the trim white? Seems like it'd look a lot more cohesive and take one color out of mix (when looking at the house, I see 6 potentially different colors going on: siding, shutters, door, trim, brick, roof). Here's an example of a similar type of house, but with a little more cohesion: https://www.younghouselove.com/our-last-minute-siding-sprint/comment-page-7/

The trim in the picture you posted is white, I do like the grey siding and black shutters, but I like a red door (I suppose that could be a focal point) I’m just wondering if a red door would look bad with the brick. Most of the windows and the door are wrapped in aluminum and cannot painted so they must stay white

I don't think a red door would look bad with the brick - but you'd have to pick the right red, of course.