Skip to content

[Feature]: Use DQX profiles to improve AI-Assisted rules generation #481

Description

@mwojtyczka

Is there an existing issue for this?

  • I have searched the existing issues

Problem statement

For automatic rules generation using LLM we need to leverage additional info.

Proposed Solution

Research on leverage additional info such as dqx profiles, uc metadata and lineage, data samples, synthetic data etc.

Examples of synthetic data approach:
https://colab.research.google.com/drive/1L6i-JhJK9ROG-KFcyzT9G-8FC3L8y8Lc?usp=sharing
https://sdv.dev/

Additional Context

No response

Metadata

Metadata

Assignees

Labels

Fields

No fields configured for Feature.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions