Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 14 additions & 2 deletions .github/workflows/cicd-main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,11 @@ jobs:
with:
base-ref: ${{ needs.pre-flight.outputs.base_ref }}

component_locks:
name: Component locks
needs: [pre-flight]
uses: ./.github/workflows/component-locks.yml

unit_tests:
name: Unit tests
needs: [pre-flight, classify_changes]
Expand Down Expand Up @@ -296,7 +301,7 @@ jobs:
retention-days: 7

Nemo_CICD_Test:
needs: [pre-flight, classify_changes, unit_tests, container_build, gpu_e2e_tests, provider_e2e_tests]
needs: [pre-flight, classify_changes, component_locks, unit_tests, container_build, gpu_e2e_tests, provider_e2e_tests]
if: always() && !cancelled()
runs-on: ubuntu-latest
steps:
Expand All @@ -308,6 +313,7 @@ jobs:
CLASSIFY_RESULT: ${{ needs.classify_changes.result }}
DOCS_ONLY: ${{ needs.classify_changes.outputs.docs_only }}
PREFLIGHT_RESULT: ${{ needs.pre-flight.result }}
COMPONENT_LOCKS_RESULT: ${{ needs.component_locks.result }}
UNIT_TEST_RESULT: ${{ needs.unit_tests.result }}
CONTAINER_BUILD_RESULT: ${{ needs.container_build.result }}
GPU_E2E_TEST_RESULT: ${{ needs.gpu_e2e_tests.result }}
Expand All @@ -317,6 +323,7 @@ jobs:
echo "Pre-flight: $PREFLIGHT_RESULT"
echo "Classify changes: $CLASSIFY_RESULT"
echo "Docs only: $DOCS_ONLY"
echo "Component locks: $COMPONENT_LOCKS_RESULT"
echo "Unit tests: $UNIT_TEST_RESULT"
echo "Container build: $CONTAINER_BUILD_RESULT"
echo "GPU E2E tests: $GPU_E2E_TEST_RESULT"
Expand All @@ -332,6 +339,11 @@ jobs:
exit 1
fi

if [[ "$COMPONENT_LOCKS_RESULT" != "success" ]]; then
echo "Component lock freshness did not succeed."
exit 1
fi

if [[ "$IS_NIGHTLY" == "true" ]]; then
# Nightly/manual runs always fall through to the nightly-job gate
# below, regardless of docs_only classification - unit_tests may
Expand Down Expand Up @@ -377,7 +389,7 @@ jobs:
notify-failure:
name: Notify test failure
runs-on: ubuntu-latest
needs: [ephemeral-runner-routing, pre-flight, classify_changes, unit_tests, container_build, gpu_e2e_tests, provider_e2e_tests, Nemo_CICD_Test]
needs: [ephemeral-runner-routing, pre-flight, classify_changes, component_locks, unit_tests, container_build, gpu_e2e_tests, provider_e2e_tests, Nemo_CICD_Test]
environment: main
permissions: {}
# Use the event directly: setup outputs are empty when setup fails.
Expand Down
3 changes: 1 addition & 2 deletions .github/workflows/component-locks.yml
Original file line number Diff line number Diff line change
@@ -1,15 +1,14 @@
name: Component locks

on:
workflow_call:
pull_request:
paths:
- '**/pyproject.toml'
- '**/uv.lock'
- '**/setup.py'
- 'scripts/component*'
- '.github/workflows/component-locks.yml'
push:
branches: [main]
workflow_dispatch:

permissions:
Expand Down
4 changes: 1 addition & 3 deletions .github/workflows/full-test-suite.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,9 +32,7 @@ concurrency:
env:
# Number of parallel shards for the full server suite. Keep in sync with the matrix below.
NUM_SHARDS: "8"
# Pin uv: 0.11.21+ supports Python 3.13.14; 0.13.4 removes the compromised CA root.
# 0.11.20 had a regression dropping pinned deps (fixed in 0.11.21).
#
# Managed lockfiles require uv 0.13.4+, including the corrected certificate trust store.
UV_INSTALL_URL: "https://astral.sh/uv/0.13.4/install.sh"

jobs:
Expand Down
7 changes: 6 additions & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -97,7 +97,7 @@ current authoritative default branch (`upstream/main` for a fork or
**Quick Start:**

```bash
# Install uv 0.11.21 or newer (required for the repository's Python version).
# Install uv 0.13.4 or newer (required by the managed lockfiles).
curl -LsSf https://astral.sh/uv/install.sh | sh
source $HOME/.local/bin/env

Expand All @@ -113,6 +113,11 @@ uv sync --extra dev --extra telemetry --extra mlflow --extra wandb
pre-commit install
```

Existing contributors using an older uv release should run `uv self update`
(or rerun the installer), then verify `uv --version` is at least 0.13.4. The
managed lockfiles reject older uv versions; no lock regeneration is needed
when upgrading uv.

The `dev` extra provides development tools, but it does not install the optional
SDKs exercised by the core unit tests. Include `telemetry`, `mlflow`, and `wandb`
as above so their installed-dependency tests run rather than fail or skip.
Expand Down
11 changes: 10 additions & 1 deletion fern/versions/latest/pages/contribute/development-setup.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,10 @@ Cloning over HTTPS needs no GitHub credentials. If you have an SSH key registere
Each component is an independent project with a committed `pyproject.toml` and
`uv.lock`. Setup uses `uv sync --locked --inexact`; stale committed locks fail setup.
Use uv 0.13.4 or newer, which includes the corrected certificate trust store.
If an existing checkout uses an older uv release, run `uv self update` (or rerun
the uv installer above) and confirm `uv --version` reports at least 0.13.4 before
syncing. Older releases are rejected by the managed projects' `required-version`
setting; upgrading uv does not require regenerating the committed locks.
Custom components and new scaffolds without a lock retain dependency resolution
from their `pyproject.toml` or `requirements.txt`.
Select optional extras per component in the environment configuration (paths are
Expand Down Expand Up @@ -64,7 +68,12 @@ python scripts/component_locks.py
```

Component exceptions to the root uv policy are recorded in
`scripts/component-lock-policy.json`. CI checks every lock on Linux and macOS.
`scripts/component-lock-policy.json`. The COMET-based `wmt_translation` and
`longmt_eval` components use Transformers 4 and Hugging Face Hub below 1 to
preserve COMET 2.2.7's supported encoder and download APIs. These isolated
components explicitly replace the shared Transformers 5 floor; other components
retain it. CI checks every lock on Linux and macOS, and `Nemo_CICD_Test` requires
both checks to succeed.

## Development Commands

Expand Down
4 changes: 1 addition & 3 deletions resources_servers/longmt_eval/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ constraint-dependencies = [
"certifi>=2026.10.19",
"msgpack>=1.2.1",
"pyarrow>=25.0.1",
"transformers>=5.17.0",
"transformers>=4.17,<5",
]
override-dependencies = [
"spacy>=3.8.13",
Expand All @@ -41,8 +41,6 @@ override-dependencies = [
"gprof2dot; sys_platform == 'never'",
"pathspec; sys_platform == 'never'",
"protobuf==6.33.6",
"transformers>=5.17.0,<6",
"huggingface-hub>=1.31,<2",
]
exclude-dependencies = [
"fasttext-wheel",
Expand Down
Loading
Loading