hydra_utils
Utilities for hydra config initialization.
Functions
Initialize a hydra config from an absolute path for a config directory |
|
Calculate warmup steps based on total tokens, block size, micro batch size, and warmup percentage. |
- initialize_hydra_config(config_path, config_name, overrides)
- Parameters:
config_path (str)
config_name (str)
overrides (list[str])
- Return type:
DictConfig
- initialize_hydra_config_for_dir(config_dir, config_name, overrides)
Initialize a hydra config from an absolute path for a config directory
- Parameters:
config_dir (str)
config_name (str)
overrides (List[str])
- Return type:
DictConfig
- register_hydra_resolvers()
- warmup_steps(tokens, block, mbs, pct=0.05)
Calculate warmup steps based on total tokens, block size, micro batch size, and warmup percentage. Used as a resolver in hydra configs.
- Parameters:
tokens (int)
block (int)
mbs (int)
pct (float)
- Return type:
int