The government is considering impeachment charges against Justice Yashwant Varma, the ex-Delhi High Court judge from whose home burnt bundles of cash were allegedly found in March.