He told all of his children that to one day work for him, they had to spend at least five years working in the tough New York real estate market