Skip to content

Fix lsql dependency#564

Merged
mwojtyczka merged 1 commit into
mainfrom
fix_deps_lsql
Sep 4, 2025
Merged

Fix lsql dependency#564
mwojtyczka merged 1 commit into
mainfrom
fix_deps_lsql

Conversation

@mwojtyczka

Copy link
Copy Markdown
Contributor

Changes

Updated lsql dependency to avoid sqlglot dependency issue when imported in artifacts repositories.

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • added end-to-end tests
  • added performance tests

Changes

Linked issues

Resolves #..

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • added end-to-end tests
  • added performance tests

## Changes
<!-- Summary of your changes that are easy to understand. Add
screenshots when necessary -->

### Linked issues
<!-- DOC: Link issue with a keyword: close, closes, closed, fix, fixes,
fixed, resolve, resolves, resolved. See
https://docs.github.com/en/issues/tracking-your-work-with-issues/linking-a-pull-request-to-an-issue#linking-a-pull-request-to-an-issue-using-a-keyword
-->

Resolves #..

### Tests
<!-- How is this tested? Please see the checklist below and also
describe any other relevant tests -->

- [ ] manually tested
- [ ] added unit tests
- [ ] added integration tests
- [ ] added end-to-end tests
- [ ] added performance tests

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Updates the databricks-labs-lsql dependency version constraint to resolve sqlglot dependency conflicts when imported in artifacts repositories.

  • Updated lsql dependency upper bound from <0.15 to <=0.16

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@github-actions

github-actions Bot commented Sep 4, 2025

Copy link
Copy Markdown
Contributor

✅ 295/295 passed, 3 flaky, 1 skipped, 2h35m40s total

Flaky tests:

  • 🤪 test_e2e_workflow (14m23.988s)
  • 🤪 test_e2e_workflow_serverless (7m29.922s)
  • 🤪 test_e2e_workflow (10m53.679s)

Running from acceptance #2212

@ghanse ghanse left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mwojtyczka mwojtyczka merged commit 9ce260e into main Sep 4, 2025
17 of 18 checks passed
@mwojtyczka mwojtyczka deleted the fix_deps_lsql branch September 4, 2025 22:03
mwojtyczka added a commit that referenced this pull request Sep 5, 2025
* Added performance benchmarks ([#548](#548)). Performance tests are run to ensure performance does not degrade by more than 25% by any change. Benchmark results are published in the documentation in the reference section. The benchmark covers all check functions, running all funcitons at once and applying the same funcitons at once for multiple columns using foreach column. A new performance GitHub workflow has been introduced to automate performance benchmarking, generating a new benchmark baseline, updating the existing baseline, and running performance tests to compare with the baseline.
* Declare readme in the project ([#547](#547)). The project configuration has been updated to include README file in the released package so that it is visible in PyPi.
* Fixed deserializing to DataFrame to assign columns properly ([#559](#559)). The `deserialize_checks_to_dataframe` function has been enhanced to correctly handle columns for `sql_expression` by removing the unnecessary check for `DQDatasetRule` instance and directly verifying if `dq_rule_check.columns` is not `None`.
* Fixed lsql dependency ([#564](#564)). The lsql dependency has been updated to address a sqlglot dependency issue that arises when imported in artifacts repositories.
@mwojtyczka mwojtyczka mentioned this pull request Sep 5, 2025
mwojtyczka added a commit that referenced this pull request Sep 5, 2025
* Added performance benchmarks
([#548](#548)). Performance
tests are run to ensure performance does not degrade by more than 25% by
any change. Benchmark results are published in the documentation in the
reference section. The benchmark covers all check functions, running all
funcitons at once and applying the same funcitons at once for multiple
columns using foreach column. A new performance GitHub workflow has been
introduced to automate performance benchmarking, generating a new
benchmark baseline, updating the existing baseline, and running
performance tests to compare with the baseline.
* Declare readme in the project
([#547](#547)). The project
configuration has been updated to include README file in the released
package so that it is visible in PyPi.
* Fixed deserializing to DataFrame to assign columns properly
([#559](#559)). The
`deserialize_checks_to_dataframe` function has been enhanced to
correctly handle columns for `sql_expression` by removing the
unnecessary check for `DQDatasetRule` instance and directly verifying if
`dq_rule_check.columns` is not `None`.
* Fixed lsql dependency
([#564](#564)). The lsql
dependency has been updated to address a sqlglot dependency issue that
arises when imported in artifacts repositories.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants