Mine has put out other limbs as it's gotten older, yours will too. That might give it more of the balance you're looking for if it put out another limb toward the fence. I don't think I would force it upright, it might really damage the root system. It will be about 10x12 if it is like mine.

Most plants will lean toward the light. Is the fence blocking the sun?

They really don't want to grow in a tree like shape with a straight trunk and leaves only on top, but want to almost form a basket shape. Mine is crowded where it is and it's hard to see but it started out like yours then grew other branches. I've seen one that was 75 years or older by an old homestead and left to grow naturally and it had the wide shape.

I took these pics at 8pm so it's dark but it's full of fruit right now with the birds and squirrels eating them like crazy.

The lean is easy to fix - just prune it back to one of the nearly vertical branches growing slightly back toward the fence, then prune or remove any near vertical branches that remain, back to an outward-facing leaf or leaf/bundle scar very near the proximal ends of the vertical branches (to ensure dominance of the newly selected leader. Reassess and correct any branching issues between leaf abscission in fall and budbreak in spring. Even with a fair measure of considering what if this and how 'bout that, I can't see each pruning session taking more than 15-20 minutes.

Al