Currently, from your description, the power goes to one of the outlet junction boxes first. A switch loop then goes from the hot leg of that power cable to the switch and then back down to the outlet (and any others that are controlled by the same switch).
You could rewire that outlet to be on all the time, change the configuration for the cable to the switch to be a hot feeder and, by running a new cable from the switch to the fan, have the fan be controlled by the switch.

Thanks for the reply Randy, but I got some help from a family member. Seems a little hokey, but I think (hope!) it's legal:

I wound up pulling the neutral on the fan over to an overhead light in the kitchen. So now the fan shares hot with the plugs in the room via a j box on the hot side of the switch (if that makes sense) and a neutral line in the kitchen via its box.

I also got a remote unit, so the fan is controlled entirely by it, without need of an in-wall switch.

Now if I could just get the insulation out from my fingers...

Nope! not legal or safe!

qwerty: care to offer something slightly constructive rather than just scold me?

Let it be known I'm not opposed to Randy's method (it probably would have been easier...), I'd just rather not have to crawl around the attic again for an hour if I don't have to.

Oh man people that do things like this are why others get killed doing simple electrical work. Some home owner simply turns off a breaker and begins to pull out an outlet to replace it, as they grab in at the neutral wire (with the fan attempting to make a circuit through it) and their other hand is touching ground ZAP! Fan makes a circuit with the heart in series, Cardiac Arrest, he/she is dead. Stuff like this aggraviates me so much because that scenario CAN happen and you really need to fix this bad mistake and not just let it go. So many diy's are happy with "it works!" A neutral can not just be stolen from any box. All conductors of the circuit must be ran together. Simply feed the switch with the outlet, run a single wire to the fan from the switch, that is less work and stealing neutrals from a random junction box and it won't kill any body or cause bad current paths through the wiring.

Never said I had a problem fixing it, just wanted some reasonable explanation other than "Nope..." I hadn't taken into account the possibility of someone getting zapped in that way, nor had I thought about re-wiring the outlet to get the power to the ceiling. This will definitely get fixed next weekend.

I never claim to be a household electrician. I come from a theater background, where the amount of juice is easily enough to kill. We just don't usually deal with circuits that need fenagled in ways like this.

Thanks for the pointed advice.