Yeah. If it didn't have a half life of a billion years it wouldn't still be around for us to mine, and all things being equal radioactivity is inversely proportional to half life.
Uranium is an alpha decay emitter. While it won't make you (literally) glow in the dark, inhaling uranium dust is pretty toxic radiologically and can cause significant damage internally. In addition, it isn't great for you chemically.
When it decays, it also releases radon, which causes additional problems.
Are there worse things? Sure. Is it safe to be around Uranium dust? No.
