Hunter wasnt just talking about paying in the financial sense, i think he was talking about paying with his life. No one, not his kids or anyone else had been put up or would even step up to do what he did all this time.
Yes and the other family members were the beneficiaries without getting their hands dirty. I think that's what Hunter was implying in that text.