In 1754 Bayly was returned for Anglesey after a contest, and was classed by Dupplin as a Government supporter. In retrospect he wrote to Bute, 11 May 1764:
In the early part of my life I had the honour to be taken notice of and was sincerely attached to the late Prince of Wales on which account I was (as some others were) under a kind of proscription in the late reign and except when your Lordship was in Administration never honoured with any mark of royal favour.
By 1761 the gentlemen of the county were ‘one and all for throwing out Sir Nicholas Bayly’
Mrs. Thrale told me that a baronet lost an election in Wales, because he had debauched the sister of a gentleman in the county, whom he made one of his daughters invite as her companion at his seat in the county, when his lady and his other children were in London.
Bayly, who insisted on standing, was defeated. ‘Although I am not in this Parliament’, he wrote to Bute on 11 May 1764,
On 14 July 1782 he wrote to Shelburne asking the King’s permission to resign because of ill-health the lord lieutenancy of Anglesey, and that it should be conferred on his son, Lord Paget.
