I'm not currently living where I can be of help, but I applaud your idea. When I lived in Vista, my neighbor used to leave his fruit picker leaning on the fence so I could reach over to pick the oranges off of his tree. He would use it to pick the lemons off mine. It was a great exchange.
I might recommend driving through some of the older neighborhoods and look for heavily-laden trees. Some retirees have had fruit trees for years, but no longer feel safe climbing ladders to pick and prune. Drop a letter on their door and I'd bet there are more than a few who would love for someone take advantage of their fruit. We're talking about the generation that learned a man's (woman's) word was gospel, you take care of your own, and you don't throw out anything that's useful.