As far as I'm concerned I prefer silent vice to ostentatious virtue.
Source, in full
Attributed to Einstein in Albert Einstein: A Documentary Biography by Carl Seelig (1956), p. 114. Einstein is said to have made this remark "when someone in his company grew angry about a mutual acquaintance's moral decline".