Born in Marylebone, London, the third son of Charles Lyttelton, 8th Viscount Cobham, Lyttelton appeared in a minor match in August 1906 when he played at Stoke Edith playing for a team of the same name against " Gentlemen of the Netherlands " and took three wickets including that of Carst Posthuma.