Drury was a fourth generation member of the junior branch of the Buckinghamshire Drurys, who had settled in various parts of Norfolk in the early sixteenth century.
Drury was elected knight of the shire for Norfolk in 1625, but not before a contest in which he and Sir Edward Coke defeated Sir Robert Gawdy and Sir Charles Le Gros*.
