Commit Graph

32 Commits

Author SHA1 Message Date
Cohee 5efdecc825 Add new OpenAI embedding models for selection 2024-03-12 21:41:30 +02:00
Kristian Schlikow 44a7dd3d74
Add NomicAI for vectorization (#1922)
* Crudely add NomicAi for vectorization

* Move NomicAI to its own endpoint, properly handle API key

* Adjust clear button html

* Remove leftover nomicai http header code

* Revert changes to openai-vectors.js

* Fix UI issues

* Revert change to settings, fix UI

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-03-12 21:10:25 +02:00
Cohee b490978142 Refactor vector models code 2024-03-02 23:16:18 +02:00
Kristan Schlikow adfb9c5097
Implement TogetherAI as vectorization provider 2024-03-01 23:52:49 +01:00
Cohee 7b8ac8f4c4 Properly use vector insert setting 2024-02-24 15:57:26 +02:00
Cohee 737a0bd3ae Fix purge extras and mistral vectors 2024-02-23 22:37:00 +02:00
Cohee 3cf01e765a #1741 Filter non-unique chunks 2024-01-26 04:18:15 +02:00
Cohee 0ad756c923 Add check for "embeddings" module. 2024-01-24 16:51:57 +02:00
Juha Jeronen 8b43535352 Initial support for Extras vectorizer, for Vector Storage 2024-01-24 15:16:55 +02:00
Cohee a2e4dc2950 Add chunking of vector storage messages 2023-12-31 04:00:04 +02:00
based 5dd2e8cd88 added mistral vector support (off the back of oai's) 2023-12-16 08:37:39 +10:00
Cohee a6bb754567 Fix API key access 2023-12-14 19:56:43 +02:00
Cohee 1b11ddc26a Add vector storage to WI scanning 2023-12-11 22:47:26 +02:00
valadaptive a37f874e38 Require single quotes 2023-12-02 13:04:51 -05:00
valadaptive c893e2165e Enable no-prototype-builtins lint 2023-12-02 12:10:31 -05:00
Cohee bb727d5f9c Insert files before user text, not after 2023-12-01 03:54:28 +02:00
Cohee 19df1f52cd Vector storage file retrieval 2023-11-30 00:01:59 +02:00
theunstableman 8f426a0184
[FIXED] Add PaLM vectorization source (#1182)
* Add PaLM vectorization source

* FIX

* Add API key check. Fix comment

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-09-25 15:29:28 +03:00
Cohee dfbeb41afa #1152 Filter repeating message hashes when inserting vectors 2023-09-19 17:12:22 +03:00
Cohee dc1121b72a Remove tensorflow vector source. 2023-09-17 14:09:24 +03:00
Cohee c9a9dab523 Don't synchronize vectors when opening chat 2023-09-11 12:35:34 +03:00
Cohee 0bdd350b8d Don't synchronize vectors while streaming 2023-09-10 20:21:23 +03:00
Cohee c9d8d7ba64 Fix vectorize all with no chat selected 2023-09-10 19:47:41 +03:00
Cohee 23951b8c8a Prevent sync and generation at the same time 2023-09-10 00:15:02 +03:00
Cohee af38971a01 Delete vectors on deleting chats 2023-09-09 22:15:47 +03:00
Cohee ed6417ebcd Display vectorization error in toast 2023-09-09 21:36:04 +03:00
Cohee 2fa038f91d Add advanced vector controls 2023-09-09 21:26:04 +03:00
Cohee 4d08e3e9be Decrease batch size. Add browser console log 2023-09-09 15:12:54 +03:00
Cohee 3a3ff89047 Add button to vectorize all chat 2023-09-08 15:25:10 +03:00
Cohee a5acc7872d Add OpenAI vector source. 2023-09-08 13:57:27 +03:00
Cohee 96df705409 Change insertion strategy to an extension block 2023-09-08 01:26:26 +03:00
Cohee 9d45c0a018 Add UI plugin for vectors 2023-09-08 00:28:06 +03:00