What would you like to be added:
Currently they are scattered in different places and there is no clear pkg that defines the contract with the plugins. We should refactor all pluggable framework interfaces and types into a separate pkg. The outcome is that a plugin should only take a dependency on that pkg.
Note that this refactor will require changes in the plugins defined in llm-d to update the dependency to the new pkg.
Why is this needed:
Separation of concern and clear definition of the contract between the framework and the plugins, especially for out of tree ones.
Ref: #2156 (comment)
What would you like to be added:
Currently they are scattered in different places and there is no clear pkg that defines the contract with the plugins. We should refactor all pluggable framework interfaces and types into a separate pkg. The outcome is that a plugin should only take a dependency on that pkg.
Note that this refactor will require changes in the plugins defined in llm-d to update the dependency to the new pkg.
Why is this needed:
Separation of concern and clear definition of the contract between the framework and the plugins, especially for out of tree ones.
Ref: #2156 (comment)