The NFL has no plan to ask Browns owner Jimmy Haslam to remove himself from operational control of the franchise while the FBI investigates his company's alleged fraud scheme, a league spokesman told The Plain Dealer on Friday.

The response from league spokesman Greg Aiello came in reaction to a report on espncleveland.com, quoting an anonymous source, that the NFL might ask Haslam to step aside. The report suggested that Haslam might be required to stay away from the team's headquarters during the proceedings.

According to documents filed in federal court Thursday, Pilot Flying J engaged in a fraud for "many years" by keeping millions of dollars owed to customers in gas rebates. It also states Haslam knew the company was shortchanging the clients.

As expected, Haslam flew to Cleveland on Thursday to help prepare for next week's NFL draft, and planned to stay through Friday. Instead, after the 120-page affidavit was unsealed and details of the alleged fraud scheme emerged, Haslam flew back to Knoxville to conduct a Friday press conference in the boardroom of Pilot Flying J.

There, an upbeat Haslam admitted he's been "rocked back" by the FBI raid and investigation, but maintained his innocence. He didn't address the Browns until he was exiting the boardroom and a reporter asked him if he'll take the team to the Super Bowl. "Eventually, yes," Haslam said with a broad smile.

A source said Haslam still plans to return to Cleveland next week for the draft, which is Thursday through Saturday.

While the NFL awaits the outcome of the investigation, some of Haslam's fellow owners are "absolutely terrified," according to Mike Freeman of CBS Sports. One NFL source told him: "More than a few owners are scared to death. The fear is that even if he did nothing wrong, the damage of the investigation alone, and the headlines that come with it, could damage a Browns organization trying to steady itself."

Some league officials told Freeman they haven't been this worried about an owner since Eddie DeBartolo Jr. was involved in a corruption case of a former Louisiana governor and ceded control of the San Francisco 49ers to his sister in 1997.