Skip to content

Commit ee077c6

Browse files
EricLBuehlerEricLBuehler
committed
chore: bump 0.8.11 -> 0.8.12
1 parent 6016c1e commit ee077c6

11 files changed

Lines changed: 221 additions & 39 deletions

File tree

‎Cargo.lock‎

Lines changed: 14 additions & 14 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

‎Cargo.toml‎

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ members = [
1919
resolver = "2"
2020

2121
[workspace.package]
22-
version = "0.8.11"
22+
version = "0.8.12"
2323
edition = "2021"
2424
description = "Fast, flexible LLM inference."
2525
homepage = "https://github.com/EricLBuehler/mistral.rs"
@@ -192,18 +192,18 @@ cuda-core = "=0.1.0"
192192
cuda-async = "=0.1.0"
193193
cuda-bindings = "=0.1.0"
194194

195-
mistralrs-core = { path = "mistralrs-core", version = "0.8.11" }
196-
mistralrs-paged-attn = { path = "mistralrs-paged-attn", version = "0.8.11" }
197-
mistralrs-flash-attn = { path = "mistralrs-flash-attn", version = "0.8.11" }
198-
mistralrs-quant = { path = "mistralrs-quant", version = "0.8.11" }
199-
mistralrs-vision = { path = "mistralrs-vision", version = "0.8.11" }
200-
mistralrs-server-core = { path = "mistralrs-server-core", version = "0.8.11" }
201-
mistralrs = { path = "mistralrs", version = "0.8.11" }
202-
mistralrs-audio = { path = "mistralrs-audio", version = "0.8.11" }
203-
mistralrs-mcp = { path = "mistralrs-mcp", version = "0.8.11" }
204-
mistralrs-macros = { path = "mistralrs-macros", version = "0.8.11" }
205-
mistralrs-code-exec = { path = "mistralrs-code-exec", version = "0.8.11" }
206-
mistralrs-sandbox = { path = "mistralrs-sandbox", version = "0.8.11" }
195+
mistralrs-core = { path = "mistralrs-core", version = "0.8.12" }
196+
mistralrs-paged-attn = { path = "mistralrs-paged-attn", version = "0.8.12" }
197+
mistralrs-flash-attn = { path = "mistralrs-flash-attn", version = "0.8.12" }
198+
mistralrs-quant = { path = "mistralrs-quant", version = "0.8.12" }
199+
mistralrs-vision = { path = "mistralrs-vision", version = "0.8.12" }
200+
mistralrs-server-core = { path = "mistralrs-server-core", version = "0.8.12" }
201+
mistralrs = { path = "mistralrs", version = "0.8.12" }
202+
mistralrs-audio = { path = "mistralrs-audio", version = "0.8.12" }
203+
mistralrs-mcp = { path = "mistralrs-mcp", version = "0.8.12" }
204+
mistralrs-macros = { path = "mistralrs-macros", version = "0.8.12" }
205+
mistralrs-code-exec = { path = "mistralrs-code-exec", version = "0.8.12" }
206+
mistralrs-sandbox = { path = "mistralrs-sandbox", version = "0.8.12" }
207207

208208
[profile.release-with-debug]
209209
inherits = "release"

‎docs/openapi.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
"license": {
1010
"name": "MIT"
1111
},
12-
"version": "0.8.11"
12+
"version": "0.8.12"
1313
},
1414
"paths": {
1515
"/calibration/apply": {

‎docs/scripts/render_pyi.py‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -514,8 +514,8 @@ def _render_index() -> str:
514514
"",
515515
"```bash",
516516
"pip install mistralrs # CPU / Metal (PyPI)",
517-
'pip install "mistralrs==0.8.11+sm89" \\ # NVIDIA (replace version + sm)',
518-
" --find-links https://github.com/EricLBuehler/mistral.rs/releases/expanded_assets/v0.8.11",
517+
'pip install "mistralrs==0.8.12+sm89" \\ # NVIDIA (replace version + sm)',
518+
" --find-links https://github.com/EricLBuehler/mistral.rs/releases/expanded_assets/v0.8.12",
519519
"```",
520520
"",
521521
"## Pages",

‎docs/src/content/docs/guides/python/getting-started.mdx‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -38,11 +38,11 @@ pip install mistralrs
3838

3939
### NVIDIA GPU (CUDA)
4040

41-
CUDA wheels are published as GitHub release assets, one per compute capability (PyPI has no GPU dimension). Install with `--find-links` pointed at the release and select your GPU's compute capability via the `+smNN` version (replace `0.8.11` / `v0.8.11` with the release you want):
41+
CUDA wheels are published as GitHub release assets, one per compute capability (PyPI has no GPU dimension). Install with `--find-links` pointed at the release and select your GPU's compute capability via the `+smNN` version (replace `0.8.12` / `v0.8.12` with the release you want):
4242

4343
```bash
44-
pip install "mistralrs==0.8.11+sm89" \
45-
--find-links https://github.com/EricLBuehler/mistral.rs/releases/expanded_assets/v0.8.11
44+
pip install "mistralrs==0.8.12+sm89" \
45+
--find-links https://github.com/EricLBuehler/mistral.rs/releases/expanded_assets/v0.8.12
4646
```
4747

4848
Look up your GPU's compute capability in [hardware support](/mistral.rs/reference/hardware-support/), which lists the published wheels per architecture. The wheels bundle the CUDA runtime, so no system toolkit is needed; they use the CUTLASS MoE backend (for the faster cuTile path, use the [prebuilt binary](/mistral.rs/quickstart/)).

‎docs/src/content/docs/quickstart.mdx‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -68,7 +68,7 @@ Prebuilt CUDA binaries are published per compute capability for Ampere and newer
6868

6969
Install-time environment variables:
7070

71-
- `MISTRALRS_INSTALL_TAG=v0.8.11` installs a specific release instead of the latest (downloads that release's prebuilt, or builds that git tag from source).
71+
- `MISTRALRS_INSTALL_TAG=v0.8.12` installs a specific release instead of the latest (downloads that release's prebuilt, or builds that git tag from source).
7272
- `MISTRALRS_INSTALL_FROM_SOURCE=1` skips the prebuilt download and builds the latest `master` (bleeding edge) from source. The prebuilt path tracks the latest stable release.
7373
- `MISTRALRS_INSTALL_NO_NCCL=1` (source builds) skips the `nccl` feature.
7474

‎docs/src/content/docs/reference/cli/update.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,5 +15,5 @@ mistralrs update [OPTIONS]
1515

1616
| Option | Default | Description |
1717
|---|---|---|
18-
| `--tag <TAG>` | | Install a specific release tag instead of the latest (e.g. v0.8.11) |
18+
| `--tag <TAG>` | | Install a specific release tag instead of the latest (e.g. v0.8.12) |
1919

‎docs/src/content/docs/reference/environment-variables.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,7 @@ These are read by build scripts, not at runtime.
8787
|---|---|
8888
| `MISTRALRS_METAL_PRECOMPILE` | `MISTRALRS_METAL_PRECOMPILE=0` skips Metal kernel precompilation at build time; kernels are compiled at runtime on first use. |
8989
| `CUDA_NVCC_FLAGS` | Extra compiler options passed to CUDA builds. |
90-
| `MISTRALRS_INSTALL_TAG` | Pins the installers to a specific release tag (e.g. `v0.8.11`): the prebuilt is downloaded from that release, and a source build checks out that git tag. Default is the latest stable release (prebuilt) or latest `master` (source). |
90+
| `MISTRALRS_INSTALL_TAG` | Pins the installers to a specific release tag (e.g. `v0.8.12`): the prebuilt is downloaded from that release, and a source build checks out that git tag. Default is the latest stable release (prebuilt) or latest `master` (source). |
9191
| `MISTRALRS_INSTALL_FROM_SOURCE` | `MISTRALRS_INSTALL_FROM_SOURCE=1` makes the shell and PowerShell installers skip the prebuilt download and build from the latest `master` (bleeding edge) instead of the latest stable release. |
9292
| `MISTRALRS_INSTALL_NCCL` | `MISTRALRS_INSTALL_NCCL=1` forces the shell and PowerShell installers to add the `nccl` feature for CUDA builds even if NCCL is not detected. |
9393
| `MISTRALRS_INSTALL_NO_NCCL` | `MISTRALRS_INSTALL_NO_NCCL=1` makes the shell and PowerShell installers skip the `nccl` feature. |

‎docs/src/content/docs/reference/python/index.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,8 +13,8 @@ The `mistralrs` Python package exposes the same engine that powers the `mistralr
1313

1414
```bash
1515
pip install mistralrs # CPU / Metal (PyPI)
16-
pip install "mistralrs==0.8.11+sm89" \ # NVIDIA (replace version + sm)
17-
--find-links https://github.com/EricLBuehler/mistral.rs/releases/expanded_assets/v0.8.11
16+
pip install "mistralrs==0.8.12+sm89" \ # NVIDIA (replace version + sm)
17+
--find-links https://github.com/EricLBuehler/mistral.rs/releases/expanded_assets/v0.8.12
1818
```
1919

2020
## Pages

0 commit comments

Comments
 (0)