Skip to content

Commit 6d38eb7

Browse files
committed
2 parents f66c1a0 + c737f00 commit 6d38eb7

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

README.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,8 @@ Nanotron is a library for pretraining transformer models. It provides a simple a
3333

3434
📚 **Check out our [Ultrascale Playbook](https://huggingface.co/spaces/nanotron/ultrascale-playbook)** - A comprehensive guide to efficiently scale LLM training with Nanotron!
3535

36+
📝 **AI generated docs thanks to [DeepWiki](https://deepwiki.com/huggingface/nanotron)**
37+
3638
## Installation
3739

3840
To run the code in this project, first create a Python virtual environment using e.g. `uv`:
@@ -108,7 +110,7 @@ For detailed instructions on training your first model, check out our [Your Firs
108110
torchrun --nproc_per_node=1 run_generate.py --ckpt-path checkpoints/{checkpoint_number}/ --tp 1 --pp 1
109111
```
110112

111-
Increase the value of `--tp` (tensor paralle) to accelerate generation with multiple GPUs and use a larger value of `--pp` (pipeline parallel) for very large models.
113+
Increase the value of `--tp` (tensor parallel) to accelerate generation with multiple GPUs and use a larger value of `--pp` (pipeline parallel) for very large models.
112114

113115
### Debugging with VSCode
114116
To debug with VSCode, add the following configuration to your `launch.json` file:

0 commit comments

Comments
 (0)