Skip to content

Allow installation in a custom folder#575

Merged
mwojtyczka merged 33 commits into
mainfrom
custom_install_folder
Sep 19, 2025
Merged

Allow installation in a custom folder#575
mwojtyczka merged 33 commits into
mainfrom
custom_install_folder

Conversation

@ghanse

@ghanse ghanse commented Sep 13, 2025

Copy link
Copy Markdown
Collaborator

Changes

This PR introduces a new installation prompt which asks users to provide a workspace path when installing DQX as a tool.

I've also refactored the engine to use WorkspaceClient().get_workspace_id() instead of WorkspaceClient().current_user.me() to support running checks on group-assigned clusters.

Linked issues

Resolves #538, Resolves #545

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • added end-to-end tests
  • added performance tests

@github-actions

github-actions Bot commented Sep 13, 2025

Copy link
Copy Markdown
Contributor

✅ 336/336 passed, 2 flaky, 1 skipped, 3h9m2s total

Flaky tests:

  • 🤪 test_e2e_workflow (9m56.323s)
  • 🤪 test_e2e_workflow_with_custom_install_folder (12m15.847s)

Running from acceptance #2416

Comment thread src/databricks/labs/dqx/checks_storage.py
enable e2e tests on nightly
Comment thread src/databricks/labs/dqx/config.py
Comment thread src/databricks/labs/dqx/profiler/profiler_workflow.py
Comment thread src/databricks/labs/dqx/quality_checker/quality_checker_workflow.py

@mwojtyczka mwojtyczka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - will merge after some manual testing

@ghanse ghanse left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 32 out of 32 changed files in this pull request and generated 4 comments.


Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

Comment thread src/databricks/labs/dqx/installer/config_provider.py
Comment thread src/databricks/labs/dqx/installer/config_provider.py
Comment thread pyproject.toml
Comment thread tests/conftest.py Outdated
@mwojtyczka mwojtyczka mentioned this pull request Oct 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

3 participants