Nvidia

Mentions across videos

stack as a really really good compute per dollar option. And that's what I actually optimize for in most cases is how many flops does this chip have and how much is it going to cost me per hour to operate to own and operate. Uh and so there are other chips that definitely rank higher than Nvidia on flops per dollar, but they may not have as much interconnect. And so it's my job to figure out what parallelism scheme am I going to use that's going to make this chip suitable for inference. It's not going to be tensor parallelism. Nvidia is basically mandatory for that. But other techniques may work well for me.

Uh and so there are other chips that definitely rank higher than Nvidia on flops per dollar, but they may not have as much interconnect.

Watch in new tab Video details at this moment

Audited predictions

Hit: 0 Miss: 0 Open: 1

Directional signals

Scroll to Top