ksuit.schedules.cosine.decreasing

Classes

CosineDecreasingSchedule

Cosine annealing scheduler with decreasing values.

Module Contents

class ksuit.schedules.cosine.decreasing.CosineDecreasingSchedule(config)

Bases: ksuit.schedules.base.DecreasingProgressSchedule

Cosine annealing scheduler with decreasing values.

Example

>>> schedule_config:
>>>   kind: ksuit.schedules.CosineDecreasingSchedule
>>>   max_value: ${model.optim.lr}
>>>   end_value: 0.0

Initialize the scheduler.

Parameters:

  • max_value – The initial and thus maximum value of the scheduler.

  • end_value – The final and thus minimum value of the scheduler.

  • config (ksuit.schemas.scheduler.DecreasingProgressScheduleConfig)