A taxi driver who said his wife had been driving when he was caught speeding has withdrawn an appeal to keep his licence.