I am not certain, but hollies like acid soil conditions, and it may be the soil isn't very acid. I think I would get a soil test done, and maybe move it, anyway. They do like reasonable drainage, but seem to cope with my acid clay just fine. It's also possible that it needs more water. I would give it a good watering, and then keep it watered well, whether you move it or not. Don't drown it, but make sure the soil stays moist, under the top 2-4" of soil - let it dry to there, check by sticking a finger in, and them water if it's dry and wait if it's wet.

If you leave it, or if you move it, I would mulch it, as widely as you can, no more than 4" deep, and putting no mulch in the 2-3" next to the trunk.

Regarding berries, a male within a quarter of a mile is usually sufficient, but having one in your yard might be a good idea.

Did it put out a flush of new growth this spring? If not, then the tree is dying. Pull it up and examine the roots. See if you can tell why it did not grow. If you do not feel like you can make a proper diagnosis of the reason it is dying, take it to the county extension agent. Make sure you have all the necessary information for them to determine what is causing it to die. Information they would need is when did you plant it, what have you done to take care of it, have you sprayed anything around it or the area such as weed killer, watering, etc. I planted one just North of you last spring and it put out several inches of new growth this spring. It is in full sun, a very hot area. It is well mulched and watered weekly the first year (if we had no rain) and watered about every two weeks this year. Next year it will be watered every three weeks and then as needed.

If you do not want to give up on the tree yet, dig down and take a root and soil sample. Contact the extension agent first for instructions if you have not done this before. You may have some type of root rot, perhaps caused by poor drainage.