Lenny Rachitsky: Okay. And then before we share some of the examples of the stuff you're seeing and get deeper, give people a sense of your background, why you have a really unique and interesting lens on this problem. Sander Schulhoff: I'm an artificial intelligence researcher. I've been doing AI research for the last probably like seven years now and much of that time has focused on prompt engineering and red teaming, AI red teaming. So as we saw in the last podcast with you, I suppose, I wrote the first guide on the internet on learn prompting, and that interest led me into AI security. And I ended up running the first ever generative AI red teaming competition. And I got a bunch of big companies involved. We had OpenAI, Scale Hugging Face, about 10 other AI companies sponsor it. And we ran this thing and it kind of blew up and it ended up collecting and open sourcing the first and largest data set of prompt injections. That paper went on to win the best theme paper at EMNLP 2023 out of about 20,000 submissions. And that's one of the top natural language processing conferences in the world. The paper and the dataset are now used by every single Frontier Lab and most Fortune 500 companies to benchmark their models and improve their AI security.
The paper and the dataset are now used by every single Frontier Lab and most Fortune 500 companies to benchmark their models and improve their AI security.