Skip to content

Add AI assistant skills for DQX#1125

Merged
mwojtyczka merged 11 commits into
databrickslabs:mainfrom
ghanse:feature/dqx-skills-1088
May 4, 2026
Merged

Add AI assistant skills for DQX#1125
mwojtyczka merged 11 commits into
databrickslabs:mainfrom
ghanse:feature/dqx-skills-1088

Conversation

@ghanse

@ghanse ghanse commented Apr 24, 2026

Copy link
Copy Markdown
Collaborator

Changes

Adds Agent Skills under skills/ that teach AI assistants how to use DQX correctly. Supports Databricks Genie Code and other tools that follow the open standard. Adds a new docs page, docs/dev/ai_tools_skills.mdx, with install + usage instructions for each tool.

Five skills, one per public-API capability:

Skill Covers
dqx-define-checks Creating rules; Includes defining DQRowRule, DQDatasetRule, DQForEachColRule in both code and metadata
dqx-apply-checks Validating data via apply checks methods in DQEngine
dqx-end-to-end End-to-end quality checking methods in DQEngine; Supports read-check-write patterns with InputConfig and OutputConfig
dqx-profile-and-generate Profiling and generating rules using the DQProfiler and DQGenerator flow
dqx-storage Loading and saving checks; Supports all *ChecksStorageConfig types

Each skill is a folder containing a single SKILL.md with the YAML frontmatter. skills/.claude-plugin/plugin.json makes the folder installable as a Claude Code plugin.

Linked issues

Resolves #1088

Tests

  • manually tested
  • added unit tests
  • added integration tests
  • added end-to-end tests
  • added performance tests

Documentation and Demos

  • added/updated docs
  • added/updated demos

Adds Agent Skills under `skills/` that teach an AI assistant how to use
DQX correctly, plus a new `docs/dev/ai_tools_skills.mdx` page covering
install + usage for Databricks Genie Code, Claude Code, and any other
tool that supports the open Agent Skills standard.

Five skills, one per public-API capability:

 - dqx-define-checks          creating quality rules (classes + YAML)
 - dqx-apply-checks           validating DataFrames / tables
 - dqx-end-to-end             apply_checks_and_save_in_table patterns
 - dqx-profile-and-generate   DQProfiler / DQGenerator / DLT generator
 - dqx-storage                load / save across file / workspace /
                              volume / table / installation / Lakebase

Each skill is a folder with a single SKILL.md (agentskills.io format).
A top-level `skills/.claude-plugin/plugin.json` makes the folder
installable as a Claude Code plugin.

Resolves databrickslabs#1088

Co-authored-by: Isaac
@ghanse ghanse requested a review from a team as a code owner April 24, 2026 18:12
@ghanse ghanse requested review from pratikk-databricks and removed request for a team April 24, 2026 18:12
Comment thread docs/dqx/docs/dev/ai_tools_skills.mdx Outdated
Comment thread docs/dqx/docs/guide/ai_tools_skills.mdx
Comment thread skills/.claude-plugin/plugin.json Outdated
Comment thread skills/dqx-apply-checks/SKILL.md Outdated
Comment thread docs/dqx/docs/dev/ai_tools_skills.mdx Outdated
Comment thread docs/dqx/docs/guide/ai_tools_skills.mdx
Comment thread docs/dqx/docs/guide/ai_tools_skills.mdx
Comment thread skills/dqx-apply-checks/SKILL.md
Comment thread skills/dqx-profile-and-generate/SKILL.md

@mwojtyczka mwojtyczka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left small comments

@mwojtyczka mwojtyczka added the under-review This PR is currently being reviewed by one of DQX maintainers. label Apr 27, 2026
@mwojtyczka mwojtyczka added needs-changes Changes required after review and removed under-review This PR is currently being reviewed by one of DQX maintainers. labels Apr 29, 2026

@mwojtyczka mwojtyczka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few additional new comments alongside the existing thread — see inline.

Comment thread skills/.claude-plugin/plugin.json
Comment thread skills/.claude-plugin/plugin.json
Comment thread docs/dqx/docs/guide/ai_tools_skills.mdx
Comment thread docs/dqx/docs/guide/ai_tools_skills.mdx Outdated
Comment thread skills/dqx-define-checks/SKILL.md Outdated
Comment thread skills/dqx-storage/SKILL.md
Comment thread skills/README.md Outdated
Comment thread skills/dqx-apply-checks/SKILL.md Outdated

@mwojtyczka mwojtyczka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Re-review — issue 1 (undefined checks_metadata) is resolved. Four follow-ups from the previous round still appear unaddressed; inline comments below.

Comment thread skills/dqx-storage/SKILL.md
Comment thread docs/dqx/docs/guide/ai_tools_skills.mdx
@ghanse ghanse changed the title feat: AI assistant skills for DQX (Genie Code, Claude Code) AI assistant skills for DQX May 4, 2026
@ghanse ghanse changed the title AI assistant skills for DQX Add AI assistant skills for DQX May 4, 2026

@mwojtyczka mwojtyczka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mwojtyczka mwojtyczka merged commit 0c308bd into databrickslabs:main May 4, 2026
18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs-changes Changes required after review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE]: DQX instructions/skills for Databricks Assistant

2 participants