Encoder (Transformers)
A component of a transformer that is used for “understanding” text. Encoders are typically used for classifying sentences by sentiment and figuring out what parts of a sentence refers, for example, to a person or location.
To learn more about decoders, you can read this to the point rundown.
Back to top