I've been a husband for almost 20 years now. "I don't feel like it" is plenty of fucking reason for not having sex. Full stop.
You are under no obligation to provide him with your body whenever he wants it. There are plenty of ways for couples to foster intimacy that aren't sex.
What would he do if you had cancer and just couldn't because of treatment?
What would he do if you were in a parasailing accident and in a full body cast?
This behavior is gross, I get having a drive etc. But that's his problem, not yours.
Remind him he's got a hand (or he can buy a fleshlight) and the internet if he's feeling that frustrated.
For the uninitiated: https://en.m.wikipedia.org/wiki/COINTELPRO