Manuel Brown's dumping from the role comes after weeks of scrutiny over his driving record and confirmation he allowed two of his underage children to drive his personal car on an outstation.