Repository navigation
Commit 338247c
feat(dynamo): adapter sidecar actor for Megatron engines behind Dynamo
Run Megatron-LM's Dynamo adapter in external-launch mode next to each
Megatron engine NeMo RL owns, so the Dynamo frontend can route to engines it
did not start. build_megatron_adapter_argv assembles the adapter command line
and rejects user overrides of pool-owned flags; engine_layout_argv records
TP/PP/EP from the same merged inference layout the engine workers use.
DynamoMegatronAdapterActor runs one adapter subprocess per engine with
node-local port picks, a readiness wait, handoff-recovery attestation, and
process-group shutdown, and is registered in the dynamo extra's venv.
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Signed-off-by: Laura Dang <laurad@nvidia.com>1 parent 67c54f0 commit 338247c
4 files changed
Lines changed: 765 additions & 0 deletions
File tree
- nemo_rl
- distributed
- models/generation/dynamo
- tests/unit/models/generation
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
58 | 58 | | |
59 | 59 | | |
60 | 60 | | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
61 | 66 | | |
62 | 67 | | |
63 | 68 | | |
| |||
0 commit comments