Not dogwood. 5 petals on each flower, alternate branching. Apple of some sort - may be a 'volunteer' seedling of ornamental crabs, courtesy of traveling birds, or could potentially be one of the native crabs - M.ioensis, M.coronaria, etc. Leaves don't look quite like M.angustifolia. Or, someone may have just tossed an apple core at that spot some years back.

Not commonly advertised in nursery catalogs, Reliance is extremely Black Knot susceptible, so hopefully that isn't a problem in your area like it is in mine. Quinces are often an overlooked fruit. There are many cultivars which are disease resistant. My favorite cydonian quinces are Champion and Portugal. They are extremely disease resistant, hardy, and bear quite well. There are a number of flowering quinces that grow well and produce good fruit, also. Flowering quinces need many hours of full sunlight per day in order to bloom. Cydonian quinces can be grown in full shade. There are many disease resistant European pears, such as Seckel which has added plus of being a natural semi-dwarf. When grafted onto a dwarf rootstock, it can be maintained at under 6 ft tall, while being loaded with fruit. You might want to check out One Green World or Raintree nursery, as they have a large selection of not so common fruits.

You have covered almost all small fruits including rasberries. Rasberries are the ones that will not fail to fruit. Most others (but not all) trees will grow nicely but may not fruit every year in Zone4~5 even if you get the hardiest ones. Apples may be one of the exception. From my experience in Zone 5, I would suggest to include "Evan" cherry in case you also discover that sweet cheries are difficult to fruit in colder zones (in addition to the associated diseases for the stone fruit trees). Evan cherry will fruit most of the years. I will also recommend CHUM (Cherry-Plum hybrid. These are hardy and available from 'DNA Gardens ...(Google it)'. Get a good combination for pollination. In addition, think about honeyberries. They fruit in colder zones. I am having problem growing Blueberries in Zone 5 so I cannot say much about it unless you want to try your luck. Keep in mind that the Zone numbers are indicative of winter harshness but not all similar Zones will have similar summer conditions. Some Zone 4 locations will have warmer summers than other Zone 4 locations with better gardening results. Good luck in your selection.

Candice The fruit you describe could be a Persimmon but their flowers are almost unnoticeable. What color is the flower? If your picture is digital (jpeg) you could open a free account on Photobucket and direct link it here. After you open the account just copy the direct link and paste it into your post. Here is the link to Photobucket http://photobucket.com/