(EAI-506 redux): Refactor full response generation as a stateless function (#498)

* refactor full response generation

* tests passing

* Fix bug

* Fix edgecase behavior

* config eval scaffold

* braintrust traced update

* update all evals to use azure openai

* fix retrieved context metric

* reduce concurrency

* update .env.exampe

* fix broken tests

* fix broken tests

* Update packages/chatbot-server-mongodb-public/src/config.eval.ts

* NL feedback

* readd verified answer metadata

* Apply suggestions from code review

Author: mongodben

package-lock.json

@@ -13,6 +13,5 @@ NODE_ENV=development
 ALLOWED_ORIGINS=http://example.com,http://localhost:5173
 OPENAI_PREPROCESSOR_CHAT_COMPLETION_DEPLOYMENT=<deployment name>
 OPENAI_API_VERSION="2024-06-01"
-JUDGE_EMBEDDING_MODEL="text-embedding-3-large"
+JUDGE_EMBEDDING_MODEL="text-embedding-3-small"
 JUDGE_LLM="gpt-4o"
-JUDGE_OPENAI_API_KEY="sk-..."