I can't be of much help because I don't live in your zone, however I know that most figs, kiwifruit, pomegranates need winters that are not freezing, so you might need to container those types so you can bring them in to shelter during the freezes. Grapevines are good in your area, as long as you plant the kind that survives cold winters.

All of my trees have grafts of several varities on them. Most of them are semi dwarfs but I keep them all pruned small. Even the standard trees can be kept small if you train them to be. (Do you really want a tree that gets as tall as the roof on your house?)

Getting trees to bear first year will be tough. You might want to see what you can find locally, perhaps boxed. Bareroot trees will need all their energy to establish itself the first year.

Usually I dont let my trees bear for 2 years after planting and once established I thin heavily so the fruit gets big.

If you want fruit the first year, focus on small fruits. Trees are a longer-term prospect. You can find extra large trees, but they are quite pricey (~$200 each here) and need to be babied a bit the first year while their roots get established, but are often able to fruit the following year. My favorite nursery calls them "baby boomers" because of the folks who tend to buy them. :)

If you are planning on moving, I would only do small fruits and container trees. Otherwise you'll expend a lot of effort and money for little or no return.

I don't live in your state either. But it IS the Garden State, right?

I'm with 'Bama. E-Z small fruit first. That would be blueberries in your area, maybe? In most places where they grow, rhubarb have few pests. Otherwise, I'm skeptical of your ability to grow things organically. From Jellyman's (a particularly expert poster on this forum) descriptions, its like trench warfare with the bugs on the Eastern seacoast.

My relatives who lived there for a while used to rave about New Jersey peaches--and they were from Georgia.

The prior message was correct that bushes and vines will give you fruit faster than trees will. Figs and kiwi will grow in your area, but you must make sure to get varieties that are cold hardy. These can be found but you need to Google "Cold Hardy figs" and do a bit of reading before you buy plants. The smaller non-fuzzy Hardy Kiwi can be grown even in zones 3 and 4, but not the bigger fuzzy kiwi. A raised bed with everbearing/day neutral strawberries will give you a really good harvest the second summer after you plant them and some the first summer. You can order bare root strawberry plants in early March that will cost a small fraction of the cost of the potted ones for sale in the summer at retail locations. They will look dead when you get them, but if you read ahead and plant properly, bare root strawberries will probably give you more fruit, faster, for less cost and effort than any other fruit. Raspberries and Blackberries are a close second. Blueberries make a great plant for the yard, but keeping the pH of the soil low enough can be difficult for some people. If your soil has a naturally high calcium level and high pH, blueberries may be eaiser to grow in containers where you control all the soil rather than fighting against a soil base that keeps raising the pH for your plant.

Someone asked a similar question in the containers forum. I have copied part of my answer to them regarding a wonderful book that could help you as well as a website for information. The book is published by Rodale Press, one of the oldest and best sources of information on organic garden and sustainable agricultural techniques. Whether you go organic or not, the book as great information about starting a backyard orchard.

....I would recommend one of my favorite books on the subject. You can get it used from one of Amazon's used book dealers for under $6 including shipping. If you want to raise a backyard orchard it is well worth the $6. It is a book that is straightforward and full of information. On Amazon's "Look Inside", you can see the table of contents, a few example pages, and the index. One of the best parts of the book is not shown in the preview. It has a 50 page alphabetic encyclopedia section, which gives almost everything you need to know about a variety of fruits from Apricots to Tayberries. All of the fruits are for small backyard gardens, and all but a few are great for containers. I cannot recommend this book high enough for beginners or experience gardeners who are new to growing fruit. In 160 pages, it has more information about a home orchard, than I have ever seen in one book, even ones many times longer.

By Rodale Press
ISBN-978-0875966380
"Backyard Fruits and Berries: Everything You Need to Know About Planting and Growing Fruits and Berries in Your Own Backyard"

One shortcoming of the book is that it was printed in 1995, so when it recommends specific varieties of plants, it will not have the newest varieties listed. This is not to say that the information is not still valuable. I have a fondness for heirloom varieties that are often some of the best tasting. Many of the advancements with new varieties are not for taste, but for better shipping for commercial growers. Some traits that commercial growers want are the opposite of what a home grower would want. Commercial growers want a plant with fruit that ripens all at once, while home growers often prefer an extended fruiting period.

Cornell Guide to Growing Fruit at Home is a great resource for gardeners in New York state and surrounding area.
"http://www.gardening.cornell.edu/fruit/index.html";

Here is a link that might be useful: Rodale Press's Backyard Fruits and Berries: Everything You Need to Know...

Thank you all for your suggestions. I appreciate a lot.
Gtippitt, thank you for recommending the book. I will certainly look for it. My little one loves grapes and organic ones are most of the time hard to find in the store, and even if I find them they are very expensive. Figs and grapes will be first on my list. I was advice that it will be hard to grow grapes organically here, but I would love to try it anyway for my little ones. Any suggestions on what variety I can grow in South New Jersey?
I got Magnolia fig cuttings that I am rooting right now. Would I need to bring it inside in winter? What other varieties would you suggest?

My advice is to just get started. You'll learn as you go. But first take a few minutes and decide what to plant. Your main decisions are 1. What do like to eat the most? 2. How much space do you have/want to give up. 3. How much effort/time do you want to spend?

Of course a small berry bush will be easier than a full size apple tree. I decided to take a middle of the road approach. I have three dwarf apple trees and two dwarf sour cherries. These five trees don't take up that much space in the yard but more importantly they are very easy to spray and net. I highly recommend dwarf trees for manageability.

The apples take a fair amount of care but it's not overwhelming. A couple sprays and then I usually bag the fruit (many posts about this). The tart cherries are the most rewarding to me because they are very low maintenance.

Get a couple bare root trees. Consider spacing and make sure they pollinate each other. Learn as you go. You can read faster then they grow. Many of the dwarfs bear fruit in 2-3 years. It will happen faster than you think. You don't need to rush it by buying 7 foot trees -they still need a couple years to get over transplant shock anyway.

Good luck.