Skip to content

PowerBIDatasetRefreshOperator - wait_for_completion = True is not working #62789

@morelgeorge

Description

@morelgeorge

Apache Airflow Provider(s)

microsoft-azure

Versions of Apache Airflow Providers

apache-airflow-providers-microsoft-azure | 13.0.0 |

Apache Airflow version

3.1.7

Operating System

RHEL 9.6

Deployment

Virtualenv installation

Deployment details

No response

What happened

I just updated to a new version of microsoft-azure provider and using PowerBIDatasetRefreshOperator. In this new version a parameter wait_for_completion has been added. If this parameter is set to True, then it should wait for the Power BI semantic model refresh. But ti does not work.
DAG operator example:

refresh_semantic_model = PowerBIDatasetRefreshOperator(
        conn_id=CONN_ID,
        task_id="refresh_sem_model",
        group_id=GROUP_ID,
        dataset_id=DATASET_ID,
        timeout=120,
        check_interval=5,
        wait_for_completion = True        
    )

returns Success but the refresh at Power BI service is still running. The latest information from DAG log is:
INFO - Dataset refresh {Dataset ID} completed with status: None

What you think should happen instead

If wait_for_completion is set to True it should wait for the semantic model refresh status until the status is "Completed" or "Failed". When the status is "Failed" the DAG should be marked as Failed, when the status is "Completed" the DAG should be marked as Success.

How to reproduce

Use the latest version of microsoft-azure provider and use wait_for_completion = True.

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions