Shmita Nutrikon Neighbors Establish Settlements Taktuf Much

The neighbors of the righteous abandoned their home with the entire tribe and went up to the hill to establish a new settlement in the Land of Israel.
Well done to them.
And the right to settle in the Land of Israel, which is considered to be the fulfillment of all the commandments (the books of Par), will be granted to them and their vast descendants.
In fact, they have many kinds of fruit in the garden, which is really impressive, and almost every day I am about to fulfill the important commandment of “Let the poor of your people eat” with these fruits, but here I am ashamed to come with sacks and fill them…
And in short, every day the mitzvah is nullified…
I thought about taking advantage of their absence and fulfilling the mitzvah with great joy, but perhaps it is immoral to take advantage of their absence for the mitzvah of settling the Land of Israel in order to empty the fruits.
 
What does the rabbi think?
(Apparently this is a passing mitzvah and cannot be done by others)