ksuit.schedules.step.decreasing¶
Classes¶
A scheduler that decreases exponentially from the maximum to minimum value over the total number of steps. |
Module Contents¶
- class ksuit.schedules.step.decreasing.StepDecreasingSchedule(config)¶
Bases:
ksuit.schedules.base.DecreasingProgressScheduleA scheduler that decreases exponentially from the maximum to minimum value over the total number of steps.
Example
>>> schedule_config: >>> kind: ksuit.schedules.StepDecreasingSchedule >>> factor: 0.1 >>> decreases_interval: 0.01 >>> max_value: ${model.optim.lr}I.e., after each 1% of the total training steps, the value is multiplied by 0.1.
Initialize the scheduler.
Args: config: The configuration for the scheduler.
- Parameters:
config (ksuit.schemas.scheduler.StepDecreasingScheduleConfig)
- factor¶
- decreases_interval¶