I'd argue that we'd need some evidence of actual intelligence, reasoning, imagination, original thinking etc.
The scary bit, imho, is that even without those, a "dumb" LLM can still do a lot of damage by just blindly following prompts without a notion for how it affects the "real world".
The scary bit, imho, is that even without those, a "dumb" LLM can still do a lot of damage by just blindly following prompts without a notion for how it affects the "real world".