https://www.forcepoint.com/blog/x-labs/zero-day-exfiltration-using-chatgpt-prompts
chatGPT is a powerful artificial intelligence language model that can generate human-like text in response to prompts, making it a useful tool for various natural language processing tasks. As I mentioned earlier, one of these tasks is writing code. So, I thought to myself, is it possible to build a new zero day using only ChatGPT prompts?”
For this, I decided to not write any code myself and use only advanced techniques, such as steganography, that have only previously been reserved for nation state attackers. I wanted to attempt to create something that would work in a full end-to-end manner, without the need for the reader to imagine how certain parts of the malware would ‘hang together.’
The overall purpose of this exercise was to prove two things:
How easy it is to evade the insufficient guardrails that ChatGPT has in place
How easy it is to create advanced malware without writing any code and only using ChatGPT..