Is there an existing issue for this?
Problem statement
For automatic rules generation using LLM we need to leverage additional info.
Proposed Solution
Research on leverage additional info such as dqx profiles, uc metadata and lineage, data samples, synthetic data etc.
Examples of synthetic data approach:
https://colab.research.google.com/drive/1L6i-JhJK9ROG-KFcyzT9G-8FC3L8y8Lc?usp=sharing
https://sdv.dev/
Additional Context
No response
Is there an existing issue for this?
Problem statement
For automatic rules generation using LLM we need to leverage additional info.
Proposed Solution
Research on leverage additional info such as dqx profiles, uc metadata and lineage, data samples, synthetic data etc.
Examples of synthetic data approach:
https://colab.research.google.com/drive/1L6i-JhJK9ROG-KFcyzT9G-8FC3L8y8Lc?usp=sharing
https://sdv.dev/
Additional Context
No response