how about roses, there are some very fragrant varieties, lavender, although it needs really good drainage to survive the winters. Sweet Olive is very fragrant in the spring. Daphne odora is also wonderful and blooms very early.

I sure hope you don't open your windows this week or your house may turn green on the inside too!
If it's a sunny area you could put two Passiflora or several Purple Hyacinth Bean Vines in a pot by a window you like to open and provide a small trellis up each side to really get the flowers close to the window. They bloom all summer long and smell great. I say put it in a pot because the Passiflora can be invasive plus, they bloom better when slightly rootbound. Purple Hyacinth Bean Vines may be direct planted as they are annuals but, are prolific seed producers. Passiflora is available in many colors and the Purple Hyacinth Bean Vine flowers are kinda dark pink more than purple, it's the seed pods that are purple.

Nothing is more fragrant to me than brugmansia and they are hardy here.

banana shrub is blooming now and i get lots of "wow" from it - intensely fragrant flowers that bloom on for about a month here. would be an early fragrant shrub if hardy in your area.
i have found it easy to care for and have not experienced any winter dieback. might like a more protected location in your zone.
contrary to this site's description of the best time for fragrance, i find it more powerful on a warm spring afternoon than early morning.
burkwood's viburnun is also blooming now and has a wonderful, sweet scent. slow-growing with an open habit for me but the fragrance is so nice!

Here is a link that might be useful: floridata

I second the choice Kathy gave you for Tea Olive (also called Sweet Olive): Osmanthus fragrans. Very available old fashioned favorite, it blooms for me in both spring and fall. The blooms are tiny but powerful. It is a shrub, however, not a perennial or annual. Evergreen and can get quite tall, but accepts pruning to control size if needed.

Sweetbox has a lovely fragrance, and my Armandii Clematis has been smelling HEAVENLY this spring. So is the daphne which blooms just before it.

I have gorgeously fragrant bearded iris, many with quite different scents.

After your gardenias bloom, I suggest planting some ginger. I have various gingers that bloom from July until the first hard frost. That scent, combined with the scents of lilies or brugmansia are heady. They smell of Southern nights to me!

GGG

Calycanthus 'Athens' is another must-have Spring-flowering fragrant shrub along with the ones mentioned.

Night blooming Jasmine (Cestrum nocturnum) is an old-fashioned fragrant Summer annual. And it is VERY fragrant. VERY perfumey. Could be too much for some people.

Gardenias, lilac, honeysuckle, ginger lilies, easter lilies (& their ilk) fill the air with fragrance, also there is a small tree (about the same size as a yoshino cherry, but faster growing) Amur Blaze Maple, which smells wonderful.

I highly recommend herbs, their flowers may or may not be inconsequential, but their leaves always smell wonderful when brushed up against. Rosemary, various basils and mints, lemon verbena, and southernwood are among my favorites. The nice thing about herbs are you can use them in cooking, potpourri and dried flower arrangements. They are fragrant all growing season, not just when blooming, and most of them are perennials or will easily reseed.

viburnum carlesi is perfuming half my yard with a single partially opened bloom right now.

I also recommend Tea Olive. Mine, like esh's, bloom spring and fall. You might also consider winter fragrant honeysuckle for late winter fragrance.

Oriental lilies provide a strong spicy-sweet fragrance later in the season. The bulbs can be tucked in among other plants. Not much to look at before and after blooming, but while they are in bloom they are gorgeous. Try Stargazer - it's easy to grow and readily available.

My tea olive is my joy from November through spring - not constantly, but it blooms in waves. Right now, dianthus are blooming - some, like Bath's Pink, are extremely fragrant. Shear them, and they'll rebloom. And my roses have already started blooming. I don't spray them, and I do have some that are very fragrant.

I've been trying to create a fragrant garden, too, and have had good success with tea olive, daphne, viburnum Mohawk, mock orange, gardenia, some varieties of lilac and iris and many, many herbs in between the roses.

Thank you to everyone for the wonderful suggestions. I now have a lot of plants to consider. :) It's cheering me up considerably after the cold destroyed the most wonderful display my azaleas had put on. I think it zapped my poor hydrangeas, too. :( Must not think about all that damage now... So, anyway...
Every year I tell myself I MUST branch out from buying just roses & irises and every year I get sucked back in to buying way too many. LOL! I've been very good this year regarding roses. Only bought one $7 at Wal-Mart, the wondeful Helen Traubul. :)

Hands down the most fragrant at my house are the Daphnes. While they seem to be picky, if you find the right spot for one you will be rewarded for weeks in early spring. I currently have 4 Daphnes, 1 that is about 6 years old, 1 that is 2 years old and 2 that are 1 year old. I have planted 7 total, so only lost 3. They like to be on the northern or maybe eastern side of the house, they do well anywhere that helleborous or hydryangea macs thrive.
All of my girlfriends clip a branch from mine in the spring to keep in their kitchens, smell great for days and days
My second choice for fragrance would be the Tea Olive, I have many of these and they are very hardy and attractive.
Annette

Can anyone tell me a good source for the tea olive? It can be local or mail order. Is this the kind of plant that I could easily find at Lowe's or Home Depot? I have some credit at Park Seed because of some failed plants last year, but cannot find it on their website. Just wondering how difficult (and expensive) this plant will be to locate.

They are cheap and available at those mentioned and wal mart. You should be able to get a big, bushy shrub for under twenty bucks.

I just looked on Growers Outlet and they have tea olive and a dwarf tea olive..3 gals/ $12.50

Yeah, I'm wondering about that dwarf tea olive. Much as I love me species tea olive, it's a huge, ungainly bush in the wrong place. I'd love to have something smaller and as fragrant!