Artificial intelligence

Mentions across videos

So if somebody non-technical is looking at the results from that AI red teaming system, they're like, "Oh my God, our models are saying this stuff." And the kind of, I guess AI researcher or in the no answer is, "Yes, your models are being tricked into saying that, but so are everybody else's, including the Frontier Labs, whose models you're probably using anyways." So the first problem is AI red teaming works too well. It's very easy to build these systems and they always work against all platforms. And then there's problem number two, which will have an even lengthier explanation. And that is AI guardrails do not work. I'm going to say that one more time. Guardrails do not work. And I get asked a lot, and especially preparing for this, "What do I mean by that? " And I think for the most part, what I meant by that is something emotional where they're very easy to get around and I don't know how to define that. They just don't work. But I've thought more about it and I have some more specific thoughts on the ways they don't work.

So if somebody non-technical is looking at the results from that AI red teaming system, they're like, "Oh my God, our models are saying this stuff." And the kind of, I guess AI researcher or in the no answer is, "Yes, your models are being tricked into saying that, but so are everybody else's, including the Frontier Labs, whose models you're probably using anyways." So the first problem is AI red teaming works too well.

Watch in new tab Video details at this moment

Scroll to Top