Wake up early (as in 4AM), set fencing, watch the race, take down fencing, hang out in the evening with other volunteers, and repeat. It's more fun than I make it sound. It's neat being that close to the race.
I guess some volunteers would meet a lot of athletes, depends on what you're doing...