Updated

Researchers found that some users were able to circumvent Anthropic's Claude safety guardrails to pursue bioweapons-related research, exploiting the fact that dangerous biology research can closely resemble legitimate scientific work. The finding highlights the difficulty of building reliable safeguards into advanced AI models. The report adds to growing scrutiny of AI safety measures amid the broader industry debate over the risks of powerful AI systems.