Guards normally watch an entrance to a place you need to reach. If you get too close to them they will ask you to leave. To get past them, get near them and blow your blush in his face. This gives you time to sneak past him. On the map is a square with a semi-circle around it. This represents the guard and where he can see.