Williams practised on the western circuit. On their father’s death in 1814, his elder brother Robert became senior partner of his London bank and Williams was left £60,000. He subsequently became a partner in the parental bank, as well as being a principal of the bank of Williams Co. at Dorchester. On 12 Nov. 1817 Thomas Wallace wrote of him from Weymouth:
His brother the Member for Dorchester is a firm friend [to government] and he has been for a year or two united with him in the banking concern which is supposed to have produced a considerable change in his political feelings—in fact I should doubt if he dared to be a violent enemy as the party supporting him here are almost to a man partisans of government.
Williams, brother-in-law of the radical Thomas Holt White, had been the champion of the independent interest at Weymouth, directed against the Johnstone family’s control, in the elections of 1806, 1807 and 1812, and in the by-election of 1813 which followed the partial success of his petition against the return. In fact, his ambitions were purely local, as his not seeking a seat elsewhere clearly demonstrates. One of his opponents in 1812, John Broadhurst, could scarcely believe that ‘that grave and pious looking gentleman Williams’
So it proved. Williams, who headed the poll after being abused as ‘a rank Burdettite’, was an opponent of government, though he eschewed party.
Williams was a steady opponent throughout of government’s repressive measures in November and December 1819. On 7 Dec. he tried to exempt meetings of electors in corporate towns from the ban imposed by the seditious meetings bill. He insisted, 13 Dec., that ministers ‘went further than the evils complained of demanded’: instead of dealing with particular manifestations of ‘pernicious doctrines’, they took away ‘the inalienable right of Englishmen’. ‘For himself he was uninfluenced by party motives. He sincerely felt that inquiry would have got rid of a great portion of the evils complained of.’ The prerequisite of social peace was ‘a moderate and rational reform’. Retaining his seat unopposed in 1820, Williams remained an advocate of civil and religious liberty in his second and last Parliament. Director of several companies after 1820, and an ardent freemason, he died 8 Feb. 1839.
