Module: tfm.nlp.encoders

Transformer Encoders.

Includes configurations and factory methods.

Classes

class AlbertEncoderConfig: ALBERT encoder configuration.

class BertEncoderConfig: BERT encoder configuration.

class BigBirdEncoderConfig: BigBird encoder configuration.

class EncoderConfig: Encoder configuration.

class FNetEncoderConfig: FNet encoder configuration.

class FunnelEncoderConfig: Funnel encoder configuration.

class KernelEncoderConfig: Linear encoder configuration.

class MobileBertEncoderConfig: MobileBERT encoder configuration.

class QueryBertConfig: Query BERT encoder configuration.

class ReuseEncoderConfig: Reuse encoder configuration.

class SparseMixerEncoderConfig: SparseMixer encoder configuration.

class XLNetEncoderConfig: XLNet encoder configuration.

Functions

build_encoder(...): Instantiate a Transformer encoder network from EncoderConfig.