Our camera can’t detect directly the weak lines of 235U (185 keV) or Plutonium.
Any way they are often shielded by containers and swamped in the background.
But fissile materials (235U, 241Am, Plutonium…) emit neutrons . Those neutrons are captured in their surrounding and emit prompt gamma rays that we detect well.