Depends how you feel, I guess. There's one trophy for giving $250 to the camp. Apart from that, you only really need to buy enough upgrades to give Pearson the ability to craft satchels for you and then give him the perfect pelts to do so. If you don't contribute any money or supplies to the camp, the other camp members might grumble a bit more, but it won't change anything in terms of story or anything else affecting game progression.
I seem to recall that giving to camp can increase your honor rating, so that might be a reason, but I sure wouldn't waste too much time dragging animal corpses back to camp.