On: I built a vulnerable app and spent $1,500 seeing if LLMs could hack it

[gck1]

No. Anthropic runs prompts through a classifier that then proceeds to do prompt injection on anything dual-use, which then results in an escalating flag on your account, which increases the strictness of the classifier and volume of prompt injections progressively.