Notes from Wikiquote
"To play golf is to spoil an otherwise enjoyable walk" is found in H.S. Scrivener, "Memories of Men and Meetings", in Arthur Wallis Myers (ed.) Lawn Tennis at Home and Abroad New York:Charles Scribner's Sons, 1903, p. 47. Scrivener attributes the aphorism to "my good friends the Allens". Reference from Quote Investigator.