You need to pick a yellow that is almost white on the chip if you go yellow. Yellow has a much, much stronger perceived color at the same saturation and brightness level than other shades. You learn a lot about that if you pick up watercolor. :) I wouldn't go taupe for something as long term as windows. White or bronze would be the only colors I would consider. Sierra white will look strongly yellow in person. The roofing above is gray. Medium gray.

Here is another one with a dark gray (soft black) like you suggested originally. Two views shown below. ^ The trim is F&B "Railings" color. F&B refer to it as a soft black http://us.farrow-ball.com/railings/paint-colours/farrow-ball/fcp-product/100031

Seems a shame to paint that brick. Maybe one of the photoshop gurus can do a mockup for you of some color options. I'm no expert, but this seems craftsman-esque, which are always so rich in color and contrast. Good luck with your decision.

If you are in a location were it freezes, you do not want acrylic paint. It's like putting a plastic bag over the brick and the paint will pop and has to be repainted every 8 years or so. Not with Lime Wash. Whitewashed brick has a charming Old World feel with a freshly painted look. You can update your home while still keeping the warmth of the brick exposed, and not having to fully commit to completely painted brick. The best part is, it’s removable! There’s no stress when deciding the color or look that you want. The paint is designed to be washed off in the first 5-days following application so you can test it as you want. It can easily be touched up because of its flat finish. It is made to last and is manufactured in Italy with the highest-quality ingredients. Classico Limewash is made from Dolomite lime from Northern Italy. It is slaked, aged like a fine wine, then specially formulated for durability with little-to-no maintenance for decades. It will continue to patina giving you an authentic, natural look for your home.