Commit Graph

53 Commits

Author SHA1 Message Date
Cohee
16785ae005 Merge branch 'staging' into neo-server 2024-04-18 22:57:27 +03:00
Cohee
5e18b1872b Hide vector summarization unless chat vectors is enabled 2024-04-18 22:32:01 +03:00
Kristan Schlikow
abd8acd9fc
Add experimental flask icon with title 2024-04-17 20:35:51 +02:00
Kristan Schlikow
977c1d4ac4
Add missing hr to the settings html 2024-04-17 20:35:51 +02:00
Kristan Schlikow
21b5bb5a29
Rearrange settings 2024-04-17 20:35:51 +02:00
Kristan Schlikow
10692523f0
Improve settings, add settings for prompt, sent message summarize toggle 2024-04-17 20:35:50 +02:00
Kristan Schlikow
a022c9eccb
Set css class for summary dropdown in vectors 2024-04-17 20:35:50 +02:00
Kristan Schlikow
4cfd0c71cf
Add extras summarization API, fix missing substitution of placeholders 2024-04-17 20:35:49 +02:00
Kristan Schlikow
a1473dedd0
Make summarization toggleable 2024-04-17 20:35:49 +02:00
Kristan Schlikow
59abee3043
Summarize the chat messages handed to the embedding beforehand 2024-04-17 20:35:48 +02:00
Cohee
9a1ea7f226 Implement Data Bank vectors querying 2024-04-17 02:09:22 +03:00
Cohee
4665db62f4 #1954 Remove backtick wrapping for inserted files 2024-04-16 22:28:10 +03:00
Cohee
123131074c Change built-in extensions template render to async 2024-04-11 23:38:44 +03:00
Cohee
5efdecc825 Add new OpenAI embedding models for selection 2024-03-12 21:41:30 +02:00
Kristian Schlikow
44a7dd3d74
Add NomicAI for vectorization (#1922)
* Crudely add NomicAi for vectorization

* Move NomicAI to its own endpoint, properly handle API key

* Adjust clear button html

* Remove leftover nomicai http header code

* Revert changes to openai-vectors.js

* Fix UI issues

* Revert change to settings, fix UI

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-03-12 21:10:25 +02:00
Cohee
b490978142 Refactor vector models code 2024-03-02 23:16:18 +02:00
Kristan Schlikow
adfb9c5097
Implement TogetherAI as vectorization provider 2024-03-01 23:52:49 +01:00
Cohee
7b8ac8f4c4 Properly use vector insert setting 2024-02-24 15:57:26 +02:00
Cohee
737a0bd3ae Fix purge extras and mistral vectors 2024-02-23 22:37:00 +02:00
Cohee
f732b8ae4c Add optional module to vectors manifest 2024-01-27 23:09:41 +02:00
Cohee
3cf01e765a #1741 Filter non-unique chunks 2024-01-26 04:18:15 +02:00
Juha Jeronen
0683d7a538 Merge branch 'staging' into tooltips-vol1 2024-01-24 17:05:09 +02:00
Cohee
0ad756c923 Add check for "embeddings" module. 2024-01-24 16:51:57 +02:00
Juha Jeronen
8b43535352 Initial support for Extras vectorizer, for Vector Storage 2024-01-24 15:16:55 +02:00
Juha Jeronen
6a03980db6 add/improve tooltips 2024-01-22 15:56:12 +02:00
Cohee
a2e4dc2950 Add chunking of vector storage messages 2023-12-31 04:00:04 +02:00
based
5dd2e8cd88 added mistral vector support (off the back of oai's) 2023-12-16 08:37:39 +10:00
Cohee
a6bb754567 Fix API key access 2023-12-14 19:56:43 +02:00
Cohee
1b11ddc26a Add vector storage to WI scanning 2023-12-11 22:47:26 +02:00
valadaptive
a37f874e38 Require single quotes 2023-12-02 13:04:51 -05:00
valadaptive
c893e2165e Enable no-prototype-builtins lint 2023-12-02 12:10:31 -05:00
Cohee
bb727d5f9c Insert files before user text, not after 2023-12-01 03:54:28 +02:00
Cohee
19df1f52cd Vector storage file retrieval 2023-11-30 00:01:59 +02:00
Cohee
5136b70882 #1355 Update summary settings button to make it more visible 2023-11-15 02:16:42 +02:00
Cohee
edb79d8c53 Synchronize max depths for plugins 2023-09-25 19:29:24 +03:00
theunstableman
8f426a0184
[FIXED] Add PaLM vectorization source (#1182)
* Add PaLM vectorization source

* FIX

* Add API key check. Fix comment

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-09-25 15:29:28 +03:00
kingbri
b52f71dcce Vectors: Add before story string/prompt option
This makes the most sense for placement of memories. Add the functionality
for other extension prompt placements as well.

Signed-off-by: kingbri <bdashore3@proton.me>
2023-09-20 00:06:43 -04:00
Cohee
dfbeb41afa #1152 Filter repeating message hashes when inserting vectors 2023-09-19 17:12:22 +03:00
Cohee
dc1121b72a Remove tensorflow vector source. 2023-09-17 14:09:24 +03:00
Cohee
6ad786f348 Add alternative local vectors source.
x5 speed boost!!
2023-09-14 23:40:13 +03:00
Cohee
c9a9dab523 Don't synchronize vectors when opening chat 2023-09-11 12:35:34 +03:00
Cohee
0bdd350b8d Don't synchronize vectors while streaming 2023-09-10 20:21:23 +03:00
Cohee
c9d8d7ba64 Fix vectorize all with no chat selected 2023-09-10 19:47:41 +03:00
Cohee
dbac2704f3 Rename control 2023-09-10 02:44:20 +03:00
Cohee
23951b8c8a Prevent sync and generation at the same time 2023-09-10 00:15:02 +03:00
Cohee
af38971a01 Delete vectors on deleting chats 2023-09-09 22:15:47 +03:00
Cohee
ed6417ebcd Display vectorization error in toast 2023-09-09 21:36:04 +03:00
Cohee
2fa038f91d Add advanced vector controls 2023-09-09 21:26:04 +03:00
Cohee
4d08e3e9be Decrease batch size. Add browser console log 2023-09-09 15:12:54 +03:00
Cohee
3a3ff89047 Add button to vectorize all chat 2023-09-08 15:25:10 +03:00