A federal judge signaled that he was leaning toward denying a request to temporarily halt work on the controversial ballroom