Skip to content
This repository was archived by the owner on Jun 5, 2025. It is now read-only.

Add FIM processing for Copilot #311

Merged
merged 3 commits into from
Dec 12, 2024
Merged

Conversation

jhrozek
Copy link
Contributor

@jhrozek jhrozek commented Dec 12, 2024

  • Move instantiating the pipelines into a pipeline factory
  • FIM pipeline for copilot

def _select_pipeline(self):
if (
self.request.method == "POST"
and self.request.path == "v1/engines/copilot-codex/completions"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

request.path or request.original_path?

This would allow us to reuse the pipelines in the copilot proxy server
without having to redefine them over and over.
@jhrozek jhrozek force-pushed the copilot_fim_pipeline branch from 0f54c4b to 49e3f5f Compare December 12, 2024 11:54
Copy link
Contributor

@ptelang ptelang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to resolve path vs original_path question. But otherwise, all looks good.

@jhrozek jhrozek merged commit 831617b into stacklok:main Dec 12, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants