This repository was archived by the owner on Jun 5, 2025. It is now read-only.
Extract packages in both input and output using the LLM the user called with #214
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ed with Instead of always using the local LLM to extract the packages, use the LLM the user called with. This is implemented in a new module llm_utils - the way it is implemented is a bit of a kludge as it really should reuse more of the providers. But because of time constraints, let's start this way and refactor later. The important thing is the PackageExtractor class that uses the provided string to extract packages out of the prompt.
lukehinds
approved these changes
Dec 5, 2024
ptelang
reviewed
Dec 5, 2024
| import structlog | ||
|
|
||
| from codegate.codegate_logging import LogFormat, LogLevel, setup_logging | ||
| from codegate.config import Config, ConfigurationError | ||
| from codegate.db.connection import init_db_sync | ||
| from codegate.server import init_app | ||
| from src.codegate.storage.utils import restore_storage_backup |
There was a problem hiding this comment.
We should not use "src" in the package name here. It should be: "from codegate.storage.utils ..."
ptelang
reviewed
Dec 5, 2024
| @@ -0,0 +1,4 @@ | |||
| from src.codegate.llm_utils.extractor import PackageExtractor | |||
| from src.codegate.llm_utils.llmclient import LLMClient | |||
There was a problem hiding this comment.
Same comment as above re: "src".
There was a problem hiding this comment.
will fix in a follow up
ptelang
reviewed
Dec 5, 2024
|
|
||
| class LLMClient: | ||
| """ | ||
| Base class for LLM interactions handling both local and cloud providers. |
There was a problem hiding this comment.
This class only handles chat requests currently. Do we need to implement code-completion support in it eventually?
There was a problem hiding this comment.
For FIM pipelines we will
ptelang
approved these changes
Dec 5, 2024
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Instead of always using the local LLM to extract the packages, use the
LLM the user called with.
This is implemented in a new module llm_utils - the way it is
implemented is a bit of a kludge as it really should reuse more of the
providers. But because of time constraints, let's start this way and
refactor later.
The important thing is the PackageExtractor class that uses the provided
string to extract packages out of the prompt.