The artist and photographer dines with Charlotte Rampling, parties with Jean Paul Gaultier and knows the best spot for a rooftop swim