Skip to content

docs: add an AbliteratedLLM custom endpoint example #936

Open

Description

@whiteworthy

Disclosure: I run AbliteratedLLM.

AbliteratedLLM is an OpenAI-compatible API (https://api.abliteratedllm.dev/v1) that serves abliterated (refusal-removed) and stock open-weight models. I'd like to add a page for it under Configuration → librechat.yaml → AI Endpoints, in the same shape as the NEAR AI Cloud page (#668): .env key, one endpoints.custom entry, and a few notes.

The notes would cover things LibreChat users would otherwise hit: the reasoning-effort control offers none and minimal, which some of our models reject; trial accounts allow one request at a time, so the default titleTiming: "immediate" title call can get a 429; and image input only works on models that list image in /v1/models.

The change is the new page, a meta.json entry (plus the generated translated sidebars), a card in the "Other compatible endpoints" list on the index, and optionally a brand icon in the same form as the NEAR icon. I've opened the change as a PR linked to this issue, so it's concrete to review. If you'd rather not list it, please close both. That's fine.

The branch and this text were prepared with an AI coding agent on my behalf. The agent followed the contributing guide, and I'll answer review questions.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions