A taxi driver fears being ordered to pay £500 after dropping a customer, who is disabled, off in a pedestrianised zone.