You wouldn't believe what we grow in our residential backyard: apples, lemons,, limes, grapefruit, apricots, pomegranates, kale, chard, radishes, turnips, sweet potatoes, basil, tomatoes, peas, and several others things I can't think of at the moment (my spouseanon who does most of the growing could probably add another dozen things to the list).
We use pretty much our whole yard for growing stuff around the year here in the SW. And we compost to improve the soil quality which was poor when we started doing this 15 years ago.
We give a lot of the fruit away to family, friends and neighbors.
It can be done. Just takes work.