Upon being asked why he was so stringent in Halachah, the Brisker Rav answered with a question of his own:
“Would you be willing to sleep on the roof of a hundred-story building, if there was no gate around its parameters? You wouldn’t want to sleep there even if you weren’t at the edge. If you are so afraid and cautious for your physical wellbeing, shouldn’t you be concerned and cautious for your spiritual wellbeing as well?”
I doubt the Brisker Rav ever saw or heard of a 100-story building.