Skip to content

[FEATURE]: JSON Validation Checks #595

Description

@ghanse

Is there an existing issue for this?

  • I have searched the existing issues

Problem statement

Validating ingested JSON is a common requirement for many ETL scenarios. Deserialization and other downstream processing are often broken when JSON is malformed or missing expected fields

Proposed Solution

Add several built-in check functions to validate JSON strings:

  • is_valid_json to detect the validity of a JSON string
  • has_json_keys to detect if 1 or more keys are present in a JSON string
  • has_json_schema to detect if a JSON string matches an expected Spark DDL schema

Additional Context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions