mlcurve
  • Blog
  • Notes

Notes / ML / Transformers

Attention

prompt - can you please explain below excerpt in details in the context of attention, encoder-decoder architechture, "To understand the flow in more details,let us consider the French translation example...

Encoder-Decoder Architecture

Encoder: The encoder processes the input sequence (e.g., a sentence) one timestep at a time. At each timestep, it produces a hidden state (hidden variable) that captures information about the...

© MLCurve