Skip to content

Conversation

@pascal-pfeiffer
Copy link
Collaborator

@pascal-pfeiffer pascal-pfeiffer commented Aug 18, 2023

run a small experiment for each problem type via CLI

in github actions (no cuda available), the test will be skipped
locally, it will run a single GPU experiment that takes about 1 minute each

closes #333

@pascal-pfeiffer pascal-pfeiffer marked this pull request as ready for review August 18, 2023 09:10
import os

from app_utils.sections.chat import show_chat_is_running_dialog
from llm_studio.app_utils.sections.chat import show_chat_is_running_dialog
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Like the idea to move app_utils to llm_studio! Is this required for the tests?
Also, in a recent discussion with @fatihozturkh2o, we where thinking of removing the utils part from app_utils folder or renaming it to something like frontend. WDYT?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's required for getting the test coverage right. I would also add this to the command. Currently looking into best ways for the report.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah, this is what we planned pretty much:

#364 (comment)

Copy link
Collaborator Author

@pascal-pfeiffer pascal-pfeiffer Aug 18, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we also need to move the train.py and train_wave.py to the code subfolder for discoverability in pytest-coverage.
I'll push this and add symlinks probably to keep the old behavior in a later PR

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

moving train.py and the other python files in the root dir is a bit more tricky than expected. I'd probably postpone for later, as it really only affects the coverage report.

Copy link
Contributor

@psinger psinger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks - great stuff!

The imports in hugging_face_utils.py are broken.

@pascal-pfeiffer pascal-pfeiffer merged commit 5d60758 into main Aug 28, 2023
@pascal-pfeiffer pascal-pfeiffer deleted the pp/test_cases branch August 28, 2023 07:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CODE IMPROVEMENT] Model training test cases

4 participants