So, I did a grid of 15 Pelicans riding bicycles for the three GPT 5.4 models across the things. And sure enough, GPT 5.4 running at X high did draw the best Pelican. Why? I don't know. I don't know why that was, but it did. Lenny Rachitsky: First of all, I didn't realize this was a test of the LLM, because you'd think an image would be a test of the imaging model, but now it makes sense. Simon Willison: It's all about the code generation. Lenny Rachitsky: That is so funny. Simon Willison: The other thing is they're generating SVG and it has comments in. So, you can see little code comments that say things like making sure the Pelican's legs are hitting the pedals, and added a fish for whimsy. And that's really fun. The Chinese AI models, I love playing with the Chinese open-weight models. Some of those have drawn quite good Pelicans, and they've run on my laptop. So, I have my laptop drawing these pictures of Pelicans with these little comments about what it's trying to do.
The Chinese AI models, I love playing with the Chinese open-weight models.