I agree that I would not trust Google maps, or even the map software that came with my GPSr. I've found both to be in error at times. I've seen a whole series of waypoints appearing on the wrong side of the street, but the right distance apart. It is unlikely that is measurement error.
One issue may be how you are taking the waypoint. If you just take a single point without giving the GPSr time to adjust to obstructions, you may lose accuracy. I've found when I jump out of the car to take a waypoint, the accuracy takes a few minutes to increase as the GPSr gathers more data from a wider field of view (without the car roof in the way) and is able to "see" (or is it hear?) more satellites.
Also, it is best to take an average reading if your GPSr has that function. I usually set mine down where I want to mark (but not right next to a building, maybe at the curb to improve field of view) and then take my photos as it is averaging. When I'm done taking pictures, I usually have pretty high accuracy (always <20 ft, but usually <10ft). That's plenty close for what we are doing.
I'm not saying you're doing it wrong, just letting you know what works for me.