Referees may impact a game through simple human error or incompetence, but outside of the NBA ref who admitted being part of a point-shaving racket, I tend to believe that most officials are honestly trying to do a good job.
It just happens that some people do a better job than others. There are good writers and bad writers, good plumbers and bad plumbers, good dentists and bad dentists - and there are good officials and bad officials.
everybody sees the game through their own perspective. I have covered thousands of HS and small college games, and every game features fans who thought the refs were out to "get" their team. If I had a buck for every time I've heard "call it both ways," I would be typing this from my resort home.