tfm.optimization.LinearWarmup

Linear warmup schedule.

tfm.optimization.LinearWarmup(
    after_warmup_lr_sched: Union[tf.keras.optimizers.schedules.LearningRateSchedule, float],
    warmup_steps: int,
    warmup_learning_rate: float,
    name: Optional[str] = None
)

after_warmup_lr_sched tf.keras.optimizers.schedules .LearningRateSchedule or a constant.
warmup_steps Number of the warmup steps.
warmup_learning_rate Initial learning rate for the warmup.
name Optional, name of warmup schedule.

Methods

from_config

@classmethod
from_config(
    config
)

Instantiates a LearningRateSchedule from its config.

Args
config Output of get_config().

Returns
A LearningRateSchedule instance.

get_config

View source

get_config() -> Mapping[str, Any]

__call__

View source

__call__(
    step: int
)

Call self as a function.