Moore withdrew from consideration for a spot on the Federal Reserve Board following the resurfacing of his racist and sexist remarks.