Skip to content

Commit 45ee467

Browse files
authored
Update README.md
1 parent 2042779 commit 45ee467

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

README.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,8 @@ To perform inference with Chronos models, install this package by running:
3333
```
3434
pip install git+https://github.com/amazon-science/chronos-forecasting.git
3535
```
36+
> [!NOTE]
37+
> We have added 🧪experimental support for [MLX](https://github.com/ml-explore/mlx) inference. If you have an Apple Silicon Mac, check out the [`mlx`](https://github.com/amazon-science/chronos-forecasting/tree/mlx) branch of this repository for instructions on how to install and use the MLX version of Chronos.
3638
3739
### Forecasting
3840

@@ -48,7 +50,7 @@ from chronos import ChronosPipeline
4850

4951
pipeline = ChronosPipeline.from_pretrained(
5052
"amazon/chronos-t5-small",
51-
device_map="cuda",
53+
device_map="cuda", # use cpu for CPU inference and mps for Apple Silicon
5254
torch_dtype=torch.bfloat16,
5355
)
5456

0 commit comments

Comments
 (0)