Am I being too hard on him?

In one word, yes. If this is the only thing you guys have had to fight about or the only thing he has (maybe) lied about then I wouldn't worry about it too much.