Prime Minister Narendra Modi on Friday expressed grief over the death of Tamil Nadu Governor La. Ganesan who passed away in Chennai at the age of 80.