Commit f1abc91
committed
Add -igm / --ignore-recurrent-model flag to disable recurrent model checkpoint behavior
When a recurrent model (e.g. Qwen3.5-MoE) is used with the server,
checkpoints, banned strings disabling, and ctx_shift disabling are
automatically applied (from commit 'server: enable checkpoint for
recurrent models (ikawrakow#1310)'). The new -igm / --ignore-recurrent-model
flag skips all this, making recurrent models behave as non-recurrent.
- Added ignore_recurrent_model field to gpt_params (default: false)
- Added CLI parsing for -igm / --ignore-recurrent-model
- Wrapped the recurrent model block in server-context.cpp with the flag check1 parent eab0359 commit f1abc91
3 files changed
Lines changed: 24 additions & 16 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3054 | 3054 | | |
3055 | 3055 | | |
3056 | 3056 | | |
| 3057 | + | |
| 3058 | + | |
| 3059 | + | |
| 3060 | + | |
3057 | 3061 | | |
3058 | 3062 | | |
3059 | 3063 | | |
| |||
3271 | 3275 | | |
3272 | 3276 | | |
3273 | 3277 | | |
| 3278 | + | |
3274 | 3279 | | |
3275 | 3280 | | |
3276 | 3281 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
572 | 572 | | |
573 | 573 | | |
574 | 574 | | |
| 575 | + | |
575 | 576 | | |
576 | 577 | | |
577 | 578 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1720 | 1720 | | |
1721 | 1721 | | |
1722 | 1722 | | |
1723 | | - | |
1724 | | - | |
1725 | | - | |
1726 | | - | |
1727 | | - | |
1728 | | - | |
1729 | | - | |
1730 | | - | |
1731 | | - | |
1732 | | - | |
1733 | | - | |
1734 | | - | |
1735 | | - | |
1736 | | - | |
1737 | | - | |
1738 | | - | |
| 1723 | + | |
| 1724 | + | |
| 1725 | + | |
| 1726 | + | |
| 1727 | + | |
| 1728 | + | |
| 1729 | + | |
| 1730 | + | |
| 1731 | + | |
| 1732 | + | |
| 1733 | + | |
| 1734 | + | |
| 1735 | + | |
| 1736 | + | |
| 1737 | + | |
| 1738 | + | |
| 1739 | + | |
| 1740 | + | |
1739 | 1741 | | |
1740 | 1742 | | |
1741 | 1743 | | |
| |||
0 commit comments