Once a building has been moved onto a public street under a permit authorized by this ordinance, the person moving the building shall continue with the moving project without interruption until it is completed, except as the permit for the moving or the city engineer specifically allows to the contrary.