Amid reports that Panetta had threatened to quit just 7 months after taking over at the spy agency, other insiders say senior White House staff members are discussing a possible shake-up of top national security officials.

"You can expect a larger than normal turnover in the next year," a senior adviser to Obama on intelligence matters told ABCNews.com.