There's no need to go the license way, yet. They can do some simple safety regulations – put a restriction on using AI with kinetic devices, life-critical situations, critical financial situations, and any situation where human is completely out of the loop. Also, put clear liability for harm caused in any situations where AI was involved on the AI supplier.
Also, they can put disclosure rules on any company that is spending more than $10M on AI.