Elon Musk is set to depart the Trump administration and leave his role as a "special government employee," a White House official told ABC News.