Ian Durrant opposed a mosque planned in Lincoln – until anti-Islamic groups called him “brother”.