Skip to content

Reduce vRAM usage during generation by allowing to transfer logits to CPU - #40870

Closed
SamuelBarryCS wants to merge 8 commits into
huggingface:mainfrom
SamuelBarryCS:transfer-logits-to-cpu
Closed

Reduce vRAM usage during generation by allowing to transfer logits to CPU#40870
SamuelBarryCS wants to merge 8 commits into
huggingface:mainfrom
SamuelBarryCS:transfer-logits-to-cpu

Update tests

d1691e5
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs