To me, it's the nature of the business - one minute you're the toast of the league, the next you're fighting for your job. The talent level in today's NFL is just so evenly matched, and the cap so punitive, that one or two injuries can just kill you. Fans will never, ever, ever be patient in this era of Sportscenter 24/7, but ownership that is willing to ride out the highs and lows helps.
Look at those Panthers - they kept David Shula on to continue working with Cam Newton... and he has blossomed this year in terms of confidence, with 5 4th quarter comebacks. I think the Ben/ Haley relationship is showing all the signs of similarly blossoming, with a bright next year coming... with the difference that now Ben isn't getting hit all the time.