New LLM Integration

[aniketmoha9]

Have you integrated this with other llm api provider like amazon bedrock or watsonx? If you have can refr me some documentation.

[ishaan-jaff]

made a PR for this: #86

[cpacker]

#67