Maybe a charcoal brown like the trim on this stone house:

Mid Century Modern Re-Visit · More Info

Here's a more dark golden brown with stone somewhat like yours:

Nottingham Tudor Brick Home featuring Millstone Accents - Tennessee · More Info

Here's a greige against orange-y brick:

Atlanta Handmade Brick · More Info

You do need to consider the color for the eaves. The darker colors you favor will make your interior darker than now.

I am trying to decide on exterior house colors, too. Hate to admit it; but, I have a red roof with brick home. The brick has some nice colors in it - gray, beige. I am changing out my gutters. I have to be careful with my color choice; because, (not the best curb appeal) my garage is large and too close to the street. Anyhoo, Soffit is creamy beige and facia is terra cotta. I would like to change the facia to med-to-dark gray. But, due to my curb appeal concern - I will be going to with brown. Hope it looks good with my soffit because I want to have the contrast. I think interior paint colors are much easier cause you can easily change them. I guess that I am just saying, it not an easy decision. However, you might want to consider a darker color choice for your facia and keep the soffit light color.

If you want to go darker than Kendall Charcoal, Ashwood Moss is a great gray.

You might want to consider hiring a color consultant for your project.

Thank you!!! You guys have given me a lot to think about. I love all the ideas!

Inspiration

Pretty!