I read at the end of your first book the claim (I will present it superficially) – God created the world because He had a kind of need for it, that is, He created us because He wanted and He is designating something for us – and this desire indicates a need He has that we need to fulfill. As stated: Mitzvot of High Necessity / The Study According to Rav Kook.
I can't understand how this approach makes sense. In itself it is understandable, but it points to something incomprehensible. After all, if God is a perfect and eternal being, how does it fit to say that He needs our actions? Doesn't that indicate imperfection, a flaw? And if so, isn't this a flawed God?
And even if we say, as a sort of Kabbalah claim, that it was his voluntary reduction to make room for us – then why was that his will?
I'm not trying to find the clear positive answer, "Why do you have to listen to the voice of the merciful lamb?" But I'm not going to the bottom of the argument of necessity.
And on the other hand, the claim of Rabbi Solovetzik in his book and the question asked there, where he says from the words of the Rambam that God created the world of His own free will, is also incomprehensible to me.