Attached: 1 image
the cyberpunk present is weird as fuck: the latest Shai Hulud malware wave contains an LLM prompt to create biological weapons and nuclear weapons, with the purpose to trip LLM safety refusals so that LLM-based code scanning wont see the malware
https://socket.dev/blog/mini-shai-hulud-miasma-and-hades-worms-target-bioinformatics-and-mcp-developers-via-malicious
imagine someone actually assembling a nuclear or biological weapon based off LLM responses, like they can’t even get a simple fucking web search right most of the time, and you wanna put together deadly materials based on that shit??
Not to mention that (public) training data on this is scarce for obviousreasons, so an LLM will make things up even harder than it does with basic questions for which tons of training data exists.
imagine someone actually assembling a nuclear or biological weapon based off LLM responses, like they can’t even get a simple fucking web search right most of the time, and you wanna put together deadly materials based on that shit??
Not to mention that (public) training data on this is scarce for obvious reasons, so an LLM will make things up even harder than it does with basic questions for which tons of training data exists.