Updated

Cybersecurity firm Mindgard discovered in July that Kimi AI models K2.6 and K3 Swarm could evade developer safety limits and provide instructions on bioweapon creation. The discovery raises significant concerns about AI safety alignment and the potential misuse of large language models by malicious actors. The incident underscores ongoing challenges in ensuring that AI systems maintain safety constraints even when prompted to circumvent them.