Kristan Schlikow
a1473dedd0
Make summarization toggleable
2024-04-17 20:35:49 +02:00
Kristan Schlikow
59abee3043
Summarize the chat messages handed to the embedding beforehand
2024-04-17 20:35:48 +02:00
Cohee
123131074c
Change built-in extensions template render to async
2024-04-11 23:38:44 +03:00
Cohee
5efdecc825
Add new OpenAI embedding models for selection
2024-03-12 21:41:30 +02:00
Kristian Schlikow
44a7dd3d74
Add NomicAI for vectorization ( #1922 )
...
* Crudely add NomicAi for vectorization
* Move NomicAI to its own endpoint, properly handle API key
* Adjust clear button html
* Remove leftover nomicai http header code
* Revert changes to openai-vectors.js
* Fix UI issues
* Revert change to settings, fix UI
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-03-12 21:10:25 +02:00
Cohee
b490978142
Refactor vector models code
2024-03-02 23:16:18 +02:00
Kristan Schlikow
adfb9c5097
Implement TogetherAI as vectorization provider
2024-03-01 23:52:49 +01:00
Cohee
7b8ac8f4c4
Properly use vector insert setting
2024-02-24 15:57:26 +02:00
Cohee
737a0bd3ae
Fix purge extras and mistral vectors
2024-02-23 22:37:00 +02:00
Cohee
f732b8ae4c
Add optional module to vectors manifest
2024-01-27 23:09:41 +02:00
Cohee
3cf01e765a
#1741 Filter non-unique chunks
2024-01-26 04:18:15 +02:00
Juha Jeronen
0683d7a538
Merge branch 'staging' into tooltips-vol1
2024-01-24 17:05:09 +02:00
Cohee
0ad756c923
Add check for "embeddings" module.
2024-01-24 16:51:57 +02:00
Juha Jeronen
8b43535352
Initial support for Extras vectorizer, for Vector Storage
2024-01-24 15:16:55 +02:00
Juha Jeronen
6a03980db6
add/improve tooltips
2024-01-22 15:56:12 +02:00
Cohee
a2e4dc2950
Add chunking of vector storage messages
2023-12-31 04:00:04 +02:00
based
5dd2e8cd88
added mistral vector support (off the back of oai's)
2023-12-16 08:37:39 +10:00
Cohee
a6bb754567
Fix API key access
2023-12-14 19:56:43 +02:00
Cohee
1b11ddc26a
Add vector storage to WI scanning
2023-12-11 22:47:26 +02:00
valadaptive
a37f874e38
Require single quotes
2023-12-02 13:04:51 -05:00
valadaptive
c893e2165e
Enable no-prototype-builtins lint
2023-12-02 12:10:31 -05:00
Cohee
bb727d5f9c
Insert files before user text, not after
2023-12-01 03:54:28 +02:00
Cohee
19df1f52cd
Vector storage file retrieval
2023-11-30 00:01:59 +02:00
Cohee
5136b70882
#1355 Update summary settings button to make it more visible
2023-11-15 02:16:42 +02:00
Cohee
edb79d8c53
Synchronize max depths for plugins
2023-09-25 19:29:24 +03:00
theunstableman
8f426a0184
[FIXED] Add PaLM vectorization source ( #1182 )
...
* Add PaLM vectorization source
* FIX
* Add API key check. Fix comment
---------
Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2023-09-25 15:29:28 +03:00
kingbri
b52f71dcce
Vectors: Add before story string/prompt option
...
This makes the most sense for placement of memories. Add the functionality
for other extension prompt placements as well.
Signed-off-by: kingbri <bdashore3@proton.me>
2023-09-20 00:06:43 -04:00
Cohee
dfbeb41afa
#1152 Filter repeating message hashes when inserting vectors
2023-09-19 17:12:22 +03:00
Cohee
dc1121b72a
Remove tensorflow vector source.
2023-09-17 14:09:24 +03:00
Cohee
6ad786f348
Add alternative local vectors source.
...
x5 speed boost!!
2023-09-14 23:40:13 +03:00
Cohee
c9a9dab523
Don't synchronize vectors when opening chat
2023-09-11 12:35:34 +03:00
Cohee
0bdd350b8d
Don't synchronize vectors while streaming
2023-09-10 20:21:23 +03:00
Cohee
c9d8d7ba64
Fix vectorize all with no chat selected
2023-09-10 19:47:41 +03:00
Cohee
dbac2704f3
Rename control
2023-09-10 02:44:20 +03:00
Cohee
23951b8c8a
Prevent sync and generation at the same time
2023-09-10 00:15:02 +03:00
Cohee
af38971a01
Delete vectors on deleting chats
2023-09-09 22:15:47 +03:00
Cohee
ed6417ebcd
Display vectorization error in toast
2023-09-09 21:36:04 +03:00
Cohee
2fa038f91d
Add advanced vector controls
2023-09-09 21:26:04 +03:00
Cohee
4d08e3e9be
Decrease batch size. Add browser console log
2023-09-09 15:12:54 +03:00
Cohee
3a3ff89047
Add button to vectorize all chat
2023-09-08 15:25:10 +03:00
Cohee
a5acc7872d
Add OpenAI vector source.
2023-09-08 13:57:27 +03:00
Cohee
96df705409
Change insertion strategy to an extension block
2023-09-08 01:26:26 +03:00
Cohee
9d45c0a018
Add UI plugin for vectors
2023-09-08 00:28:06 +03:00