I know people will say 'well maybe they're just not good at gift giving'.

That is a load of fucking bullshit. Everyone is a fantastic gift giver if they actually care about and value the person. Gift giving is a pretty fool proof way to determine where you stand with someone. And I think he's been very clear with you about how much he thinks you have.