There are a couple of things to unpack here.

First, if you are under 55 or so, chances are you have no memory of the actual celebrity status the astronauts had. They were national heroes and treated that way. They knew better than to fall for stunts by idiots.

Second, the astronauts went to basically astronaut school, first ran by Gen. Chuck Yeager, and part of their training was how to act in public and not disgrace the nation or NASA especially the astronauts.

This reaction to an idiot with a bible was what was to be expected, he didn't punch the guy out for shoving a Bible in his face. He just extracted himself from the situation.