"A lot of people think that the president of the New York Fed works for the U.S. government. But in fact you work for the private banks that elected you."