Entering a house of idolatry

Hello Rabbi.
From studying the Daf Yomi, I settled on a question: In Mishnah Ba’Z 11: It is said that one should not go to the fair of Az. And in Gm. there is doubt whether it is better to go near Beit Az or near Beit Bushet. However, the Maimonides in the Mishnah Torah did not rule according to the Halacha in the P’A that one should not enter Beit Az, and even the Shulchan Aruch ruled (Yod. 4:55, 1) that “it is a commandment to keep away from the path of idols four times.” This means that he has established a blanket prohibition. The Maimonides in the P’A wrote (P’A 44): “Therefore, know that every city of a nation in which they have a house of prayer that is a house of idolatry – without a doubt that city is forbidden to pass through intentionally, let alone to live in it. But we are under their hands in our sins and dwell in their land as forced laborers, and what is said in Deuteronomy 4 applies to us: ‘And you worshipped there other gods, the work of man’s hands, wood and stone.’ And if the city is ruled in this way, it is even more difficult to rule over the house of idolatry itself, which is almost forbidden to us to see, let alone to live in it. “To enter it.” And he quoted his words from the Shach (Yod. 4:19, 1). And I saw that the poskim, based on the words of the Rambam, take that there is an absolute prohibition to enter the house of the prophet (and discuss the matter of entering churches), but apparently the words of the Rambam do not teach that there is a formal prohibition to enter the house of the prophet, and just as we have not seen anyone who refrained from living in Jerusalem or another city that has churches, and apparently because there is no formal prohibition to live in a city that has a prophet, so there is no formal prohibition to enter the house of the prophet, and this explains why the Rambam did not rule this as a halakhic ruling in the Mishnah Torah (and even the author’s commentary does not teach about a formal prohibition). And according to this understanding, nowadays people enter churches/mosques as part of a trip without any interest in the religious aspect, apparently there is no problem with this. But I searched and did not see any discussion of this opinion in the poskim (except in the discussion regarding the definition of Christianity and Islam, etc.). What do you think?
Thank you, good evening.