According to Cato the Elder, Scipio Africanus was wont to say that he was never less at leisure than when at leisure, nor less alone than when alone.
P. Scipionem [...] dicere solitum scripsit Cato [...] numquam se minus otiosum esse, quam cum otiosus; nec minus solum, quam cum solus esset.
Original text (Latin)
Notes from Wikiquote
Book III, section 1