His mother probably died in childbirth. His birth occurred at Coleshill probably because it was the home of his father's nearest cousin, Joan (later his father's second wife), while Dudley Castle was occupied by his father's widowed mother and (since Nov 1359) her second husband, Richard le Fissher, with whom John de Sutton was in frequent litigation. After the death of his father about 1369 his wardship and marriage were granted to Richard Fitz Alan, Earl of Arundel. during this period he was married to Joan Le Despencer. He served in the King's Fleet under the Earl of Arundel after he came of age.