Nuclear Radiation at the Lunar Surface, Barton -- found in Advances in the Astronautical Sciences vol 6, proceedings of the American Astronautical Society 1960 annual meeting and printed by Macmillan in 1961.
He estimates contribution of the Moon versus both natural radionuclides and secondary radiation activated by "spallation, fission, fragmentation and capture." His estimate is that during a quiet sun what he calls the induced radiation (neutrons, gamma, and protons) would contribute a weekly dose of .5 millirems. The primordial granite and basalt is ALREADY contributing 2.5 millirems.
Now, this was taken before lunar samples had been returned, and the actual neutron value is apparently surprisingly higher. Science marches on. I quote from this book to show:
1) The secondary radiation was described publicly years before the Apollo flights.
2) The secondary radiation could be derived by anyone from first principles; it didn't need spacecraft to go out and look and since any college physics student could do it, it isn't something that can be or was hidden.
3) Physicists clearly separate the short-duration secondary activation from long-lived radioisotopes.
4) The human effect we are talking about is trivial. According to this estimate, the kitchen counter in your fancy home is a bigger threat to your health. Yeah, basically; until they start labeling lumps of granite as "danger, radioactive" museums aren't going to do a damn thing about some dust that happens to be on a pressure suit!
(And now to repack...I really didn't want to dig for that book but I finally had to. What's the use of owning it if I don't use it every now and then?)