Mayor Chow, Councillor Bradford insist they're focused on city issues instead, while ex-mayor Tory lurks in shadows