For decades, Susan Herman loved her second home in Sag Harbor, N.Y., so much that whenever circumstances changed in her.