The logic of the Prime Minister's argument that Brexit has done more harm than good only points in one direction, argues Simon Nixon