‘It’s just a special place, what can I say. So we have to take care of it,’ Trump said of the White House