I've gotten rust stains off with No.7 Brand Chrome Polish. The Lemon juice should do well for you, but this is something else to try. Works well if the rust isn't in pitted out glass. Yeah, pitted glass, Only in the paint of old ad glasses.