504 - Impeached from the Hall of Fame?

Ever wonder what it would take to get impeached from a Hall of Fame? Is it once in, always in?