I agree with peanut - Layer up!! I grew up (like Annie) in Invers, and now live in Dunedin - both Sub-antartic weather. I hate the cold, but love feeling cosy when it is cold.
I always wear a long singlet in the winter, and some form of Polypro/merino, and a top over that, I live in beanies. Get some good quality socks, I

my merino/polypro/possum ones - they cost me $30 but soooo worth it!
For Elle - I always put her in a singlet, long sleeve woolen singlet/polypro (babycity have 2 thermals for $13.99, they are great) and then a top, with woolen jersy/cardi when we are going out.
If you have a Multifuel fire, get some coal, it'll bank it well overnight so you can stir it up in the morning and it'll go once you put more wood on it (yes I know its not good for the environment, but Waiouru is darn cold!!)