Yeah, but there are also members of all the other parties there. Also, when I volunteered, I got the feeling that most (if not all) election assistants take their duty seriously and emphasize their neutrality while performing it.
Whenever I've been observer I never had the slightest feeling that any of the volunteers would place party allegiance over diligent work. But that's exactly why we're all invited to go and observe.