[Usage]: how to change the path of download models

[eternal8080]

Motivation.

how can I change the path of my download models?

Proposed Change.

how can I change the path of my download models?

Feedback Period.

how can I change the path of my download models?

CC List.

how can I change the path of my download models?

Any Other Things.

how can I change the path of my download models?

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

We use HuggingFace Hub for downloading most models, you can refer to their own documentation

[reidliu41]

you can try HF_HOME env var, e.g

vllm serve facebook/opt-125m
INFO 04-23 06:23:57 [__init__.py:239] Automatically detected platform cpu.
config.json: 100%|█████████████████████████████████████████████████| 651/651 [00:00<00:00, 1.20MB/s]
tokenizer_config.json: 100%|███████████████████████████████████████| 685/685 [00:00<00:00, 13.1MB/s]

$ ls ~/.cache/huggingface/hub/models--facebook--opt-125m/
blobs     refs      snapshots

$ mkdir /tmp/test-hf-download
$ export HF_HOME=/tmp/test-hf-download
$ vllm serve facebook/opt-125m
INFO 04-23 06:26:05 [__init__.py:239] Automatically detected platform cpu.
config.json: 100%|█████████████████████████████████████████████████| 651/651 [00:00<00:00, 1.00MB/s]
tokenizer_config.json: 100%|███████████████████████████████████████| 685/685 [00:00<00:00, 14.0MB/s]
$ ls /tmp/test-hf-download/hub/models--facebook--opt-125m/
blobs     refs      snapshots