Question

Hello and greetings to the Rabbi, may he live long and well,
In the place where I live there is a gym that offers separate hours for men and women, but the level of aesthetics there is really very poor (to the point that once I found a frog in the shower area…) and it’s really not pleasant to work out and swim there. The operating hours also don’t work for me. By contrast, there is a gym run by non-Jews that is cleaner and more comfortable to work out in. 
Should one refrain from going there? (To the gym and the swimming pool.) And does the fact that Jewish women work there change the situation?