Skip to content

Report filename and file size in modelLoader #122

@kerthcet

Description

@kerthcet

What would you like to be cleaned:

Here's the current output of model loader:

Skipping virtualenv creation, as specified in config file.
2024-09-03 14:49:03,464 - __main__ - INFO - loading models from modelhub takes 0:03:15.848986s
Start to download model TheBloke/Llama-2-7B-GGUF
Skipping virtualenv creation, as specified in config file.
2024-09-03 14:45:45,397 - __main__ - INFO - loading models from modelhub takes 0:11:10.482161s
Start to download model TheBloke/Llama-2-7B-GGUF
Error from server (BadRequest): container "model-runner" in pod "llamacpp-speculator-0" is waiting to start: PodInitializing

If we're downloading GGUF files, there's no file name and the file size, we should report that as well.

Why is this needed:

Better observation.

Metadata

Metadata

Assignees

Labels

cleanupCategorizes issue or PR as related to cleaning up code, process, or technical debt.needs-kindIndicates a PR lacks a label and requires one.needs-priorityIndicates a PR lacks a label and requires one.needs-triageIndicates an issue or PR lacks a label and requires one.

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions