I agree, evaluation of consciousness is another problem entirely.
However, the point I'm making is that even assuming an agent/thing is capable of achieving consciousness, it would have to have a suitably complex environment and the capability of forming an independent feedback loop with that environment to even begin to display conscious capability.
If the agent/thing is capable of achieving consciousness but is not in a suitable environment, then we'd likely never see it doing things that resemble consciousness as we understand it. Which is something we have seen occur in the real world many times.
However, the point I'm making is that even assuming an agent/thing is capable of achieving consciousness, it would have to have a suitably complex environment and the capability of forming an independent feedback loop with that environment to even begin to display conscious capability.
If the agent/thing is capable of achieving consciousness but is not in a suitable environment, then we'd likely never see it doing things that resemble consciousness as we understand it. Which is something we have seen occur in the real world many times.