nvalchemi.distributed.HookScope

class nvalchemi.distributed.HookScope(*values)

Determines which ranks execute a hook callback.

LOCAL

Hook runs on every rank with its local subdomain batch.

Type:

str

GLOBAL

Hook runs on every rank after an all-gather produces the full batch.

Type:

str

RANK_ZERO

Hook runs only on rank 0 after gathering.

Type:

str