A language model uses attention to relate tokens at different positions in a sequence. Which architecture is associated with this mechanism?

1. A storage lifecycle policy
2. A hash table as the complete language model
3. A network route table
4. Transformer