Apache Airflow Provider(s)
microsoft-azure
Versions of Apache Airflow Providers
apache-airflow-providers-microsoft-azure | 13.0.0 |
Apache Airflow version
3.1.7
Operating System
RHEL 9.6
Deployment
Virtualenv installation
Deployment details
No response
What happened
I just updated to a new version of microsoft-azure provider and using PowerBIDatasetRefreshOperator. In this new version a parameter wait_for_completion has been added. If this parameter is set to True, then it should wait for the Power BI semantic model refresh. But ti does not work.
DAG operator example:
refresh_semantic_model = PowerBIDatasetRefreshOperator(
conn_id=CONN_ID,
task_id="refresh_sem_model",
group_id=GROUP_ID,
dataset_id=DATASET_ID,
timeout=120,
check_interval=5,
wait_for_completion = True
)
returns Success but the refresh at Power BI service is still running. The latest information from DAG log is:
INFO - Dataset refresh {Dataset ID} completed with status: None
What you think should happen instead
If wait_for_completion is set to True it should wait for the semantic model refresh status until the status is "Completed" or "Failed". When the status is "Failed" the DAG should be marked as Failed, when the status is "Completed" the DAG should be marked as Success.
How to reproduce
Use the latest version of microsoft-azure provider and use wait_for_completion = True.
Anything else
No response
Are you willing to submit PR?
Code of Conduct