If you outlaw uranium, then only outlaws will have uranium. And they’ll use it to make bombs. That’s just a matter of time no matter what we do, unless we achieve complete long-term technological stagnation.
If you let ordinary law-abiding folk have it, they’ll find much better uses for it. Especially after a few of them have experimented with it for a while. Some of those uses will end up making it much easier to survive the inevitable advent of nutcases with nuclear weapons. (Not to mention plagues, natural disasters, and global climate change). And, of course, all of them will add up to lots more liberty and wealth for everyone, which is always worth a certain amount of risk.