host the the MLP the the weights essentially on the Cerebrus chip but the GPU has the capacity to scale to really long context lengths and so you would like to put the uh attention possibly on the GPU and the MLP on the cerebrus chip >> and I believe this is what's happening with Nvidia and Grock. Can you riff for a minute just on transformers and uh >> yeah, you've been so good at explaining some of the core concepts just for people that again aren't aren't deeply familiar with what this innovation was in 2017 >> like what its strengths and weaknesses
host the the MLP the the weights essentially on the Cerebrus chip but the GPU has the capacity to scale to really long context lengths and so you would like to put the uh attention possibly on the GPU and the MLP on the cerebrus chip >> and I believe this is what's happening with Nvidia and Grock.