tfm.optimization.PolynomialWarmUp

Applies polynomial warmup schedule on a given learning rate decay schedule.

tfm.optimization.PolynomialWarmUp(
    after_warmup_lr_sched: Union[tf.keras.optimizers.schedules.LearningRateSchedule, float],
    warmup_steps: int,
    power: float = 1.0,
    name: str = 'PolynomialWarmup'
)

Methods

from_config

@classmethod
from_config(
    config
)

Instantiates a LearningRateSchedule from its config.

Args
config Output of get_config().

Returns
A LearningRateSchedule instance.

get_config

View source

get_config() -> Mapping[str, Any]

__call__

View source

__call__(
    step
)

Call self as a function.