Oops, I was thinking of the tamograph on the back of the trailer and on the shoulders of Nemesis Prime. I don't think an eraser would quite get the plastic symbols.
)
As for the stamps though, I used a plain old white staedtler eraser. Took a few minutes of rubbing, but took the stamps off completely and (on Nem. Prime) didn't affect the finish at all.