ksuit.schedules.step.decreasing

Classes

StepDecreasingSchedule

A scheduler that decreases exponentially from the maximum to minimum value over the total number of steps.

Module Contents

class ksuit.schedules.step.decreasing.StepDecreasingSchedule(config)

Bases: ksuit.schedules.base.DecreasingProgressSchedule

A scheduler that decreases exponentially from the maximum to minimum value over the total number of steps.

Example

>>> schedule_config:
>>>    kind: ksuit.schedules.StepDecreasingSchedule
>>>    factor: 0.1
>>>    decreases_interval: 0.01
>>>    max_value: ${model.optim.lr}

I.e., after each 1% of the total training steps, the value is multiplied by 0.1.

Initialize the scheduler.

Args: config: The configuration for the scheduler.

Parameters:

config (ksuit.schemas.scheduler.StepDecreasingScheduleConfig)

factor
decreases_interval