-
Notifications
You must be signed in to change notification settings - Fork 415
Feat: last pipeline run section in dashboard #3250
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
8054e89 to
21c3dd6
Compare
Deploying with
|
| Status | Name | Latest Commit | Preview URL | Updated (UTC) |
|---|---|---|---|---|
| ✅ Deployment successful! View logs |
docs | e1a163c | Commit Preview URL Branch Preview URL |
Nov 14 2025, 06:25 PM |
65991c7 to
b029cfa
Compare
|
terminology (from https://www.notion.so/dlthub/dlt-Entities-their-Lifecycles-and-Relations-2679fb8e23cf80169921c4ea069bfff8?source=copy_link#2679fb8e23cf8109b9c3eee928a2a377). definitions are pretty clear and you can easily refer to code
Idea display status of load package(s) as boxes like the "COMPLETED"
schema indicators
for later
feedback to current UI |
878eba9 to
c9e6bda
Compare
c9e6bda to
60307b4
Compare
rudolfix
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM. all the comments are minor. visually is really good.
you could add example pipeline with partially loaded package:
@dlt.destination
def wait_forever(item, schema):
# never exit
from time import sleep
# this one does not wake up on signal
while not _done:
sleep(1)
# make the job fail if it gets here
raise KeyboardInterrupt()
pipeline = dlt.pipeline(
"signal_waiter", destination=wait_forever(), dataset_name="_data", progress=DictCollector()
)you can modify this destination so it passes for one table but raises for another triggering "partially loaded" state.
| failed: bool | ||
|
|
||
|
|
||
| def _format_duration(ms: float) -> str: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we have humanize library. it should be able to generate friendly strings. ie humanize.precisedelta pls take a look
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
humanize doesn't seem to be generating friendly enough strings - I think it's better to leave it the way it is currently 👀
f6e713a to
e06d81b
Compare
e06d81b to
6550200
Compare
rudolfix
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
This PR introduces a new pipeline run section to the dashboard app which uses a simple html snippet.