I'd be a bit skeptical about the survivability of loropetalum in your climate. Typically it is rated to zone 7 but they fail to thrive in my zone 8b/9 simply because our summers are not hot enough to ripen the wood sufficiently to withstand winter cold. There are some decent alternatives to both the Japanese barberry and the loropetalum that feature dark or maroon foliage. Several weigelas - 'Wine and Roses', 'Midnight Wine', 'Burgundy Baby'. Also a dwarf ninebark, Physocarpus 'Little Devil'. If you wanted to try a larger shrub, Corylus 'Red Dragon', a burgundy leafed form of Harry Lauder's walking stick (contorted filbert). And there are the many purple, maroon or burgundy leafed forms of coral bells, Heuchera, that retain their foliage throughout the year in milder climates. But these are not exactly shrubby in nature or in size :-)

Japanese Cleyera (Terstroemia gymnanthera) can grow quite tall and fairly quickly in the South. Guessing around 10 to 15 feet (or more?) depending on culture. Up here in Mid-Atlantic zone 7a they don't grow as quickly. Mine are blooming and bearing sort of pendulous fruit capsules. Interesting, but not really ornamental. You could keep the ones on either side of the window and relocate the ones that interfere. Or maybe just keep one on the corner. If you want year-round curb appeal for this side of the house, I'd not choose perrenials, unless they were evergreen. I'd go for something like a low pittosporum, ardisia, yaupon, carrisa holly, pachysandra, or something to that effect, depending on exposure.

It's a variety of Hemlock. Maybe Tsuga canadensis ‘Cole’s Prostrate’.

Kind words thefof but I need to make a confession. Although it seemed familiar I finally got it by googling 'blue daisy bush'.