Prosecutors from US attorney's office in Washington were turned away after an unannounced visit to the Fed, according to ABC citing sources