The Odisha Police have arrested the head priest of an ashram in Dhenkanal district for allegedly raping a 35-year-old woman inmate, officials said.