Fish can easily go for two weeks without us feeding them, especially in a tank with algae and microcritters for them to munch on. If you need to leave him for two-three days at a time, he'd be absolutely fine without food for those days, we can assure you.
Even though fish always act hungry, that's more about being opportunistic feeders, and routine, where when you approach the tank/lift the lid, and they're classically conditioned to mean that means they're about to be fed. But remember that they're not mammals. Fish take their body temp from the water they're in, so they don't need food as frequently as mammals do. Since they don't have to keep that internal temperature up themselves, the way mammals have to. We all tend to overfeed our fish as a general rule, just because it's fun to feed them, lets us interact with them, but a lot of people (myself included!) have a fast day every week, or even two fast days.
It's also much safer and much less stressful than trying to move him and a tank back and forth! Or using autofeeders, which can fail and wind up causing more problems than helping. People here will even leave their tanks unfed if they're on vacation for a week or two, rather than risk the water quality issues that can happen with a malfunctioning autofeeder, or having someone else feed the tanks as a favour, when there's such a high risk of a well meaning person overfeeding the fish, the uneaten food producing an ammonia spike, and coming home to dead fish.
So don't fret about a weekend or long weekend away, he'll be okay while you're gone for a few days, and you can treat him when you return!