I'm pretty sure it is a Mickey Mouse plant (that's actually the common name!). It is a serious weed, as you can imagine from the berries. They are difficult to pull out of the ground, since they have a right-angled tap root. When they're small the best way to get rid of them is by digging out, otherwise you need to "cut and paint" with poison. I reckon if you wnet for a walk around you place you will see many more in bushland and gardens.

I've not seen this in Canberra before. Looks pretty nice, amazing it's a noxious weed. Hope you manage to have it under control missraff.

http://www.bfns.org.au/index.php?c=3&w=24

What a shame! It is very pretty! I googled Mickey Mouse plant and yes, that is indeed what it is. And yes, I've seen it around the area now that I've noticed it in my yard. Well, I'll just have to get rid of it I guess. Thanks very much for the info.