If they caught you in the moment when you have already spent all your money, then great, because you really won’t have anything to lend, and you won’t be able to say yes even if you want to.
However, even when they are right timing, still, don’t feel obliged to give them anything. It’s not being selfish…well, it kind of is, but hey, you have to be selfish from time to time, too.
