Ok, I get the "my problem" part (I'm sleep deprived and can't go to sleep yet). I didn't mean you can't help. But the only way is to talk with him and ask him what could help aside from you dropping your friends. But in the end these are his feelings and insecurities that he has to deal with, you can only do so much and sacrificing yourself in a process isn't going to help in a long run. I understand that jealousy is a feeling and those aren't logical, but he doesn't trust you to the point where he is "sad" for a whole day...?

It looks like you do talk about it with him, otherwise you wouldn't know any of the things you wrote. Can you explain what does he mean by saying it's definitely your problem that you have to sort out on your own? What exactly he thinks is "your problem" here?

Answering your question, you want to still have said friends and be able to hang out with them. He can accept it or leave. It's definitely his problem and he has to deal with it on his own. But it's concerning that his behavior is escalating in a wrong direction. Trying to make it your problem and being "sad" for a whole day is a little concerning.