Gotta agree. Vinegar and water. Rinse as best you can. But unlike using soap (which you should NEVER do) if a little vinegar is left behind, it's only likely to buffer the ph a little. Don't sweat it, it won't hurt anything.
And if it still doesn't come off, a little baking soda/vinegar paste and a good scrubbing will help too!