[BUG]: does_not_contain_pii function is not working

[nilaksh92]

Is there an existing issue for this?

• I have searched the existing issues

Current Behavior

We are getting below error while implementing PII detection DQ function.

Have installed the below library

Import is working fine

Function Definition

can you please help on this?

Expected Behavior

We are getting below error while implementing PII detection DQ function.

Have installed the below library

Import is working fine

Function Definition

can you please help on this?

Steps To Reproduce

No response

Cloud

AWS

Operating System

macOS

Relevant log output

[mwojtyczka]

Thank you for reporting this. We will provide a fix in the upcoming release.

For now, please provide custom_check_functions parameter when applying checks defined as dics/yaml:

from databricks.labs.dqx.pii.pii_detection_funcs import does_not_contain_pii

checked_df = dq_engine.apply_checks_by_metadata(df, checks, custom_check_functions={"does_not_contain_pii": does_not_contain_pii})