ksuit.schedules.step.fixed

Classes

StepFixedSchedule

A scheduler that progresses at fixed steps and increases or decreases by some factor at these steps.

Module Contents

class ksuit.schedules.step.fixed.StepFixedSchedule(config)

Bases: ksuit.schedules.base.ScheduleBase

A scheduler that progresses at fixed steps and increases or decreases by some factor at these steps.

Initialize the scheduler.

Parameters:

config (ksuit.schemas.scheduler.StepFixedScheduleConfig) – Configuration for the step fixed schedule.

Example

>>> schedule_config:
>>> kind: ksuit.schedules.StepFixedSchedule
>>> factor: 0.1
>>> start_value: ${model.optim.lr}
>>> steps:
>>>   - 0.01
>>>   - 0.02
>>>   - 0.03

Lower LR by factor 0.1 at 1%, 2%, and 3% of total training steps.

steps
start_value
factor