Because of their prevalance many people think that ants must be a problem when they are not. Ants are part of Ma Natures recylcing machine, those critters that help get rid of the "stuff" we throw away, or that Ma Nature need gotten rid of. Ants harvest Aphids, but if you really look close you will not see and ant take an Aphid from the nest back to a plant. Ants may well clean up seedlings, that did not germinate, but I've not seen a problem with ants carrying off seeds that I put down. While I have seen ants working on a plant something else (cutworm) damaged, along with Pill Bugs, I have not seen them damage an undamaged plant.
There is no real reason to do anything to control ants in your garden.