I think you just answered your own question. Even if you don't frame it as a letdown, an opposing team might just have more of an edge (coming off of a loss, desperate for a win, etc).
If you're Alabama it means you only win by 10. If you're the Gophers (or most teams), it means you lose...