Skip to content

PGvector vector database support #3788

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
May 9, 2025
Merged

Conversation

timothycarambat
Copy link
Member

@timothycarambat timothycarambat commented May 8, 2025

Pull Request Type

  • ✨ feat
  • πŸ› fix
  • ♻️ refactor
  • πŸ’„ style
  • πŸ”¨ chore
  • πŸ“ docs

Relevant Issues

resolves #873

What is in this change?

  • Support for AnythingLLM managed pgvector support for PostgreSQL v12+
  • Handle table creation, management, and search with user defined or default table name

Additional Information

does not work with existing pg table!! We will not support this because we require specific schema to store, write, and access vectors

Developer Validations

@timothycarambat timothycarambat added PR:Ready-to-merge PR has been reviewed by core team and is ready to merge and removed PR:Ready-to-merge PR has been reviewed by core team and is ready to merge labels May 9, 2025
@timothycarambat timothycarambat merged commit e1b7f58 into master May 9, 2025
1 check passed
@timothycarambat timothycarambat deleted the 873-pgvector-support branch May 9, 2025 19:27
lohawk-azalea pushed a commit to azalea-gograbcode/anything-llm that referenced this pull request May 25, 2025
* Updated README.md and README.zh_CN.md (Mintplex-Labs#3775)

* Update README.zh-CN.md

* Update README.zh-CN.md

* Update README.zh-CN.md

* Update README.md

* Merge commit from fork

* linting

* match openai versions across collector/backend

* Updated README.md and README.zh-CN.md (Mintplex-Labs#3776)

* Update README.zh-CN.md

* Update README.md

* Update README.md

---------

Co-authored-by: Timothy Carambat <[email protected]>

* Enable workflow rule for package verification (Mintplex-Labs#3778)

enable workflow rule

* Update README.zh-CN.md (Mintplex-Labs#3780)

* Update README.zh-CN.md

* Update README.zh-CN.md

* Chat prompt history menu (Mintplex-Labs#3770)

* wip system prompt history sidebar ui

* lint

* backend/frontend implementation for prompt history wip

* lint

* rework ui

* add delete menu and delete chat history by id

* lint

* ref for menu button

* reorganize components + light mode styles

* lint

* UI refactor

* backend refactor

* remove unused import

* add border-none to all buttons

* fix spacing on dots 3 icon button

* add window to confirm

* add english translations

* normalize translations

* lin

* patch store logic

* sticky header

---------

Co-authored-by: timothycarambat <[email protected]>

* fix null entry on new workspace

* minor UI patches (Mintplex-Labs#3784)

* Updated zh locale (Mintplex-Labs#3786)

* Update common.js

* linting

---------

Co-authored-by: timothycarambat <[email protected]>

* locale change (Mintplex-Labs#3787)

* Update common.js

* Update common.js

* lint

---------

Co-authored-by: timothycarambat <[email protected]>

* Add Disable Spellcheck Option (Mintplex-Labs#3795)

* Implemented spellcheck toggle in Settings

* ran yarn lint

* reduce read complexity for appearance spellcheck
lint

---------

Co-authored-by: timothycarambat <[email protected]>

* Update:WorkspaceChat-ChatContainer-PromptInput (Mintplex-Labs#3792)

update:WorkspaceChat ChatContainer PromptInput

Co-authored-by: Timothy Carambat <[email protected]>

* updated locale (Mintplex-Labs#3796)

* Update README.zh-CN.md

* Update common.js

* PGvector vector database support (Mintplex-Labs#3788)

* PGVector support for vector db storage

* forgot files

* comments

* dev build

* Add ENV connection and table schema validations for vector table
add .reset call to drop embedding table when changing the AnythingLLM embedder
update instrutions
Add preCheck error reporting in UpdateENV
add timeout to pg connection

* update setup

* update README

* update doc

* add error fix for pgvector

* Fix MCP Start/Stop Toast Text (Mintplex-Labs#3803)

* corrected toggle server toast text

* reordered code for readability

* reordered code for readability

* ran yarn lint

* reordered code for readability

* ran yarn lint

* Fixed grammar and typos (Mintplex-Labs#3802)

* Update common.js

* Update README.md

* Update common.js

* Update README.md

* linting

---------

Co-authored-by: timothycarambat <[email protected]>

* patch Azure image reading regressions
resolves Mintplex-Labs#3811

* Obsidian data connector (Mintplex-Labs#3798)

* add obsidian vault data connector

* lint

* add english translations

* normalize translations

* improve file parser and reader

---------

Co-authored-by: timothycarambat <[email protected]>

* Sponsors Showcase (Mintplex-Labs#3816)

* Fix typos (Mintplex-Labs#3826)

* Fix typos

* language

---------

Co-authored-by: timothycarambat <[email protected]>

* Update light mode designs for system prompt history (Mintplex-Labs#3818)

* update light mode designs for system prompt history

* lint

---------

Co-authored-by: Timothy Carambat <[email protected]>

* Warn bad docker command (Mintplex-Labs#3827)

* Add context window finder from litellm maintained list
apply to all cloud providers, have client cache for 3 days

* docker container bootup warning

* update invalid ENV warning

* rebased with current HEAD

* update newline printing

* Automatic Context window detection (Mintplex-Labs#3817)

* Add context window finder from litellm maintained list
apply to all cloud providers, have client cache for 3 days

* linting

* Improve UX for API keys and invitations (Mintplex-Labs#3828)

* fix ux for create api key and create invite

* lint

---------

Co-authored-by: Timothy Carambat <[email protected]>

* Support Dell Pro AI Studio provider (Mintplex-Labs#3829)

* forgot files for DPAIS

* patch api key bad ref.current on add post removal

* hoisting cleanup for format var

* Optional summarization for web-scraping flow block (Mintplex-Labs#3496)

* remove summarization from web-scraping flow block

* add option to enable/disable summarization in web-scraping block

* change layout
summarize default to true (was the normal prior)

---------

Co-authored-by: Timothy Carambat <[email protected]>

* 3416 file picker load times (Mintplex-Labs#3833)

* wip

* implment conditional streaming

* no bench

* patch Cached tag in UI not showing from Mintplex-Labs#3833

* Respect Max Chunk Len set - Generic OpenAI Embedder connection (Mintplex-Labs#3838)

Respect Max Chunk Len set
resolves Mintplex-Labs#3834

* Disable message send while content is embedding (Mintplex-Labs#3832)

* Disable message send while content is embedding

* opacity

* normalize langs

* remove console log

---------

Co-authored-by: shatfield4 <[email protected]>

* fix folders accumulating many files

* refactor citation parser

* Updated Chinese locale (Mintplex-Labs#3852)

* Update README.zh-CN.md

* Update common.js

* Update common.js

* remove comment in file util

* zh lint

* Filter malformed post-processed docs from file picker (Mintplex-Labs#3853)

Filter malformed post-processed files from UI

---------

Co-authored-by: Shixian Sheng <[email protected]>
Co-authored-by: Timothy Carambat <[email protected]>
Co-authored-by: Sean Hatfield <[email protected]>
Co-authored-by: Colin Perry <[email protected]>
Co-authored-by: Lao <[email protected]>
Co-authored-by: omahs <[email protected]>
cabwds pushed a commit to cabwds/anything-llm that referenced this pull request Jul 3, 2025
* PGVector support for vector db storage

* forgot files

* comments

* dev build

* Add ENV connection and table schema validations for vector table
add .reset call to drop embedding table when changing the AnythingLLM embedder
update instrutions
Add preCheck error reporting in UpdateENV
add timeout to pg connection

* update setup

* update README

* update doc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEAT]: pgvector support
1 participant