Comments by "James Rivett-Carnac" (@jamesrivettcarnac) on "Attention in transformers, step-by-step | DL6" video.

  1. 12:02 I've been thinking of other languages throughout this series, and how would this work in Japanese, which later words impact earlier words? Do you just ditch this training step?
    1