I used to go to the gym and was right into this body fat % thing. There are a couple of things that can make it inaccurate.
One thing is dehydration - ie if you go out and get plastered the night before getting your fat % done, it will appear to come in light because you are actually dehydrated. Also you have to make sure you use the exact same set of scales to measure each time, as there are variances between makes/models of scales.
I was about 25% when I started at the gym and got down to about 20% (that was my goal). I'd hate to think what I am now!!!