Concerns are rising over the recent defections of key executives at Fannie Mae and Freddie Mac.