ksuit.schedules.cosine.increasing

Classes

CosineIncreasingSchedule

Cosine annealing scheduler with increasing values.

Module Contents

class ksuit.schedules.cosine.increasing.CosineIncreasingSchedule(config)

Bases: ksuit.schedules.base.IncreasingProgressSchedule

Cosine annealing scheduler with increasing values.

Example

>>> schedule_config:
>>>   kind: ksuit.schedules.CosineIncreasingSchedule
>>>   max_value: ${model.optim.lr}
>>>   start_value: 0.0

Initialize the scheduler.

Parameters:

  • start_value – The initial and thus minimum value of the scheduler.

  • max_value – The final and thus maximum value of the scheduler.

  • config (ksuit.schemas.scheduler.IncreasingProgressScheduleConfig)