Repository navigation
docs: add AbliteratedLLM endpoint guide - #937
Open
whiteworthy wants to merge 2 commits into
Open
whiteworthy wants to merge 2 commits into
whiteworthy wants to merge 2 commits into
Conversation
|
@whiteworthy is attempting to deploy a commit to the LibreChat's projects Team on Vercel. A member of the Team first needs to authorize it. |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Disclosure: I run AbliteratedLLM.
Closes #936
Summary
Adds an AbliteratedLLM custom endpoint guide under the LibreChat YAML AI endpoints docs, following the format of the NEAR AI Cloud page (#668).
The example uses:
ABLITERATEDLLM_API_KEYhttps://api.abliteratedllm.dev/v1glm-5.3-flash-abliteratedas the default model andtitleModelmodels.fetch: true, since/v1/modelsis public and returns the live listEvery key in the example (
name,apiKey,baseURL,models.default,models.fetch,titleConvo,titleModel,modelDisplayLabel) and the keys named in the notes (titleTiming,apiKey: "user_provided") are documented in the custom endpoint object structure page. There is nodropParamsoraddParams. LibreChat's stop-sequence control already caps at 4 entries, which is the API's limit. For these model IDs, LibreChat sends the output limit asmax_tokensonly and reasoning asreasoning_effort, and the API accepts both.The Notes section covers three things a LibreChat user could hit:
noneandminimal.glm-5.3-flash-abliteratedrejects both, and the other GLM models rejectnone.titleTiming: "immediate"title call can get a 429. The note suggeststitleTiming: "final"ortitleConvo: false.imageininput_modalities.Other changes:
meta.json:abliteratedllmadded in alphabetical order. The 13meta.<locale>.jsonsidebars were regenerated withnode scripts/sync-locale-meta.mjs --writesopnpm check:locale-metastays green. Each gets the same one-line addition.index.mdx: card added to "Other compatible endpoints" (AbliteratedLLM isn't inKnownEndpoints).components/icons/providers/abliteratedllm.tsx, export,lib/icons.tsxmap entry, andicon:frontmatter), in the same form as the NEAR icon. It's a separate commit so it can be dropped without touching the page.This PR was prepared with an AI coding agent on my behalf.
Testing
node scripts/sync-locale-meta.mjs --write(regenerated the translated sidebars), then--check: "translated sidebars match the English pages"npx prettier@3 --checkon the changed.tsx,.tsandmeta.jsonfiles, using the repo's.prettierrc.js: cleangit diff --check origin/main...HEAD: cleancurl -fsSL https://api.abliteratedllm.dev/v1/models | jq -e '.data | map(.id) | contains(["glm-5.3-flash-abliterated"])'→trueNot run:
pnpm typecheck,pnpm lintandpnpm build, which need the full install. Thelibrechat.yamlentry has not been tested in a running LibreChat instance, and no API key was used. The details in the notes come from the provider's API behaviour, not from a LibreChat run.