Haredi logic

In many of my arguments with Haredim, I have noticed a recurring logic that is, exclusive reliance on the Torah and Chazal (even on midrashim) and making them absolute truth. One example that stands out to me the most is, someone told me that you don’t need to study the heart in school because, by calculation, the heart is 4 hours a day (minimum) and in that time you can study Gemara and since there is a world to come, they will sue you for being able to get another 4 hours of “endless mitzvah” as he called it and you wasted it on the heart. Similarly, in relation to just non-Torah literature, he brought me some midrash that says that everything is laid out in the Torah. In short, it is a bit difficult to argue with the logic that says that “the Torah and Chazal are everything in life and are the absolute truth.” My question is how do you think it is possible to attack such a way of thinking from a logical or Torah perspective because I have a feeling that all the arguments are unfounded, but it is difficult for me to explain exactly why.