-
Notifications
You must be signed in to change notification settings - Fork 415
Dashboard Improvements #2965
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dashboard Improvements #2965
Conversation
✅ Deploy Preview for dlt-hub-docs ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
80deb2a to
a46c910
Compare
…as in pipeline overview
add multi schema pipeline to fixtures
add buttons to open pipeline folder and local data folder if present
… helpful error message in this case
show pipeline error screen also when manually chnaing the pipeline name in the url
dc14b66 to
6c2a2e5
Compare
zilto
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A few minor changes and notes for follow-up tickets. Excited to see this go live!
docs/website/docs/dlt-ecosystem/verified-sources/openapi-generator.md
Outdated
Show resolved
Hide resolved
| @@ -1,5 +1,5 @@ | |||
| --- | |||
| title: View data with Streamlit | |||
| title: The legacy streamlit app | |||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What about View data with Streamlit (legacy) ?
| """Returns a connected ibis backend for the dataset. Not implemented for all destinations. | ||
| Args: | ||
| read_only (bool): Whether to open the connection in read only mode. Only used for duckdb. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The read_only flag seems like a good addition, but why / how is it only for duckdb ?
Let's open a follow-up ticket to apply read_only to other backends. (If the backend doesn't support read only, we log a warning)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
|
|
||
| :::info | ||
| Make sure you have `streamlit` installed: `pip install streamlit` | ||
| Make sure you have `marimo` installed: `pip install marimo` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should have a dlt[dashboard] extra in pyproject.toml. Let's open an issue with this follow-up task + documentation update
djudjuu
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lg now
zilto
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the fix!
* remove uneeded file * fix forwarding of pipelines dir to marimo app * disable state sync and display all schemas and remote state and schemas in pipeline overview * add support for multiple schemas * fix e2e tests, further updates pending * use dropdown instead of multiselect for schema selection add multi schema pipeline to fixtures * add last run info in pipeline overview add buttons to open pipeline folder and local data folder if present * fix loads browser to select correct schema * allow to start dashboard for a pipeline that is not there yet and add helpful error message in this case * nicer last run time formatting show pipeline error screen also when manually chnaing the pipeline name in the url * move buttons to top, add refresh buttons to sections * use raw query when constructing queries * lazy load remote state tab * fix traces and trace typing (mostly) * add exception traces to ui * add file watcher * remove test code * add source and resource state viewer to data panel * update existing unit tests * add unit test for new utils * make marimo dashboard the default app for pipeline show * update docs * update existing e2e tests for new yaml based rendering of state * move streamlit app down in sidebar * grammar fixes for dashboard strings * open duckdb in readme mode in datapanel in dashboard * remove old tests re-enable dashboard main command * add missing args to dashboard command * small fixes to e2e tests * add tests for exceptions * re-organize e2e tests into invidual tests * add basic schema selection checks * improve dashboard help and dashboard docs page * short some strings in testing to make selecting predictable * merge devel * typo --------- Co-authored-by: djudjuu <[email protected]>
Description
This PR improves the dashboard preview. It includes:
ToDos