Absolutely Lesser Goldfinch. By the way, I don't know how much time you spent looking at warbler pics, but you would have saved yourself that effort by noting the bill shape: warblers have much thinner bills. Bill shape and size is often a good clue to point you in the right direction; bright colour patterns you'll likely remember without trying, but the bill really needs to be looked at (unless we're talking about a toucan or spoonbill etc). Just a friendly hint. -O-

It would help to take and post a photo-it could be an escaped pet, or a lost tropical species like a Rufous-capped Warbler http://www.kiwifoto.com/galleries/birds/rufous_capped_warbler/

Atlamol, I was just coming to post a pic I found of a white winged crossbill! But there are 2 probs: 1) I haven't gotten a good look at the beAk yet and 2) I live in northwest GA. My book shows there may be a pocket of red crossbills in this area but does not show any white winged presence. It also says they very rarely show up at feeders but that's where I'm seeing these birds. tsugajunki, I also thought pine grosbeak for a while but then realized it's larger than the bird I'm seeing. There are quite a few of these in my yard - maybe up to 10. What in the world would they be doing so far away from their territory? According to my book (Peterson) they don't even migrate here.

I agree with your ids of house finch and verdin. I don't live in an area with nesting verdin, so cannot attest to their protective nature concerning nests. But many of the smaller bird species choose instead to build in spiny or dense bushes for protection and try to lure threats away from the nest by making a verbal fuss, rather than physical attacks. I enjoyed seeing your photos.