Commit Graph

61 Commits

Author SHA1 Message Date
Cohee
a122109e0c Add new model option 'embed-v4.0' to Cohere vectorization settings
Closes #3951
2025-05-04 12:26:44 +03:00
pl752
07fb92b37d Added vector secondary url placeholder example 2025-04-16 17:39:29 +05:00
pl752
f8bccb472f Adjusted naming and validation 2025-04-16 17:34:58 +05:00
pl752
5cf3198da1 Added option to use secondary API URL in vector extension 2025-04-16 16:04:33 +05:00
Cohee
78bda9954d Increase maximum injection depth and WI order (#3800) 2025-04-13 21:31:57 +03:00
Cohee
70fe5b6e01 Add Gemini embedding model for vector storage 2025-04-01 21:42:26 +03:00
Cohee
80e821d12d Add support for KoboldCpp embeddings in Vector Storage (#3795)
* Add support for KoboldCpp embeddings in vector processing

* Add validation for KoboldCpp embeddings to handle empty data

* Improve toast handling
2025-04-01 21:21:29 +03:00
Cohee
1cb9287684 Vectors WebLLM (#3631)
* Add WebLLM support for vectorization

* Load models when WebLLM extension installed

* Consistency updated

* Move checkWebLlm to initEngine

* Refactor vector request handling to use getAdditionalArgs

* Add error handling for unsupported WebLLM extension

* Add prefix to error causes
2025-03-09 00:51:44 +02:00
Cohee
f83dccda39 Mark 'Extras' option as deprecated in built-in extensions 2025-02-08 21:56:54 +02:00
Cohee
77bee453ab Vectors: Add only custom boundary chunking 2025-01-03 20:44:25 +02:00
Cohee
df3d7a048e Deprecate unscoped vectors 2024-09-24 21:51:10 +03:00
Cohee
9ef3385255 Implement collection scopes for vector models (#2846)
* Implement collection scopes for vector models

* Update makersuite-vectors.js to use Gemini API text-embedding-004 model

* Add model scope for Google vectors

* Fix purge log

* Refactor header setting

* Fix typo

* Only display UI warning if scopes disabled

* Remove i18n attribute

---------

Co-authored-by: ceruleandeep <83318388+ceruleandeep@users.noreply.github.com>
2024-09-16 09:29:39 +03:00
Cohee
06e3d5f8de Rename MakerSuite => AI Studio 2024-08-21 21:00:17 +03:00
Cohee
53c24174e7 Merge branch 'staging' into webgpu-summary 2024-08-13 20:54:46 +03:00
Cohee
d0b368f29c Vector Storage: change NomicAI key input 2024-08-13 20:50:41 +03:00
Cohee
4888e3c2b0 Vector Storage: summarize with WebLLM extension 2024-08-13 19:34:11 +03:00
Cohee
b8830e34d3 Add ollama download shortcut to vector storage 2024-06-22 16:38:00 +03:00
Cohee
bba16f5263 Custom vector chunk boundary 2024-06-16 02:16:27 +03:00
steve green
3ede4aafbe Update zh-cn.json (#2376)
* Update zh-cn.json

* html changes

* `div`->`span`

* fixes

* fixes

* more fixes

* Revert last divs

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-06-14 22:46:40 +03:00
Cohee
4e822eeebb Add VLLM as vector source 2024-06-09 01:03:22 +03:00
Cohee
39721b6a8f Add file chunks overlap control 2024-06-06 21:45:47 +03:00
Cohee
865c48bcc0 Cohee forgot the ABC 2024-05-28 22:57:07 +03:00
Cohee
2b3dfc5ae2 Add ollama and llamacpp as vector sources 2024-05-28 22:54:50 +03:00
Cohee
967a7980f5 Add vector retrieval score threshold 2024-05-23 17:28:43 +03:00
Cohee
4370db6bdc Implement World Info activation using Vector Storage 2024-04-23 03:09:52 +03:00
Cohee
ca89be8930 Add experimental setting for file translation 2024-04-21 03:24:01 +03:00
Cohee
80de3fdd4c Add buttons to process and purge file vectors for current chat 2024-04-19 00:16:23 +03:00
Cohee
25cb598694 Add Cohere as embedding source 2024-04-19 00:07:12 +03:00
Cohee
16785ae005 Merge branch 'staging' into neo-server 2024-04-18 22:57:27 +03:00
Cohee
5e18b1872b Hide vector summarization unless chat vectors is enabled 2024-04-18 22:32:01 +03:00
Kristan Schlikow
abd8acd9fc Add experimental flask icon with title 2024-04-17 20:35:51 +02:00
Kristan Schlikow
977c1d4ac4 Add missing hr to the settings html 2024-04-17 20:35:51 +02:00
Kristan Schlikow
21b5bb5a29 Rearrange settings 2024-04-17 20:35:51 +02:00
Kristan Schlikow
10692523f0 Improve settings, add settings for prompt, sent message summarize toggle 2024-04-17 20:35:50 +02:00
Kristan Schlikow
a022c9eccb Set css class for summary dropdown in vectors 2024-04-17 20:35:50 +02:00
Kristan Schlikow
4cfd0c71cf Add extras summarization API, fix missing substitution of placeholders 2024-04-17 20:35:49 +02:00
Kristan Schlikow
a1473dedd0 Make summarization toggleable 2024-04-17 20:35:49 +02:00
Cohee
9a1ea7f226 Implement Data Bank vectors querying 2024-04-17 02:09:22 +03:00
Cohee
5efdecc825 Add new OpenAI embedding models for selection 2024-03-12 21:41:30 +02:00
Kristian Schlikow
44a7dd3d74 Add NomicAI for vectorization (#1922)
* Crudely add NomicAi for vectorization

* Move NomicAI to its own endpoint, properly handle API key

* Adjust clear button html

* Remove leftover nomicai http header code

* Revert changes to openai-vectors.js

* Fix UI issues

* Revert change to settings, fix UI

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-03-12 21:10:25 +02:00
Cohee
b490978142 Refactor vector models code 2024-03-02 23:16:18 +02:00
Kristan Schlikow
adfb9c5097 Implement TogetherAI as vectorization provider 2024-03-01 23:52:49 +01:00
Juha Jeronen
0683d7a538 Merge branch 'staging' into tooltips-vol1 2024-01-24 17:05:09 +02:00
Juha Jeronen
8b43535352 Initial support for Extras vectorizer, for Vector Storage 2024-01-24 15:16:55 +02:00
Juha Jeronen
6a03980db6 add/improve tooltips 2024-01-22 15:56:12 +02:00
Cohee
a2e4dc2950 Add chunking of vector storage messages 2023-12-31 04:00:04 +02:00
based
5dd2e8cd88 added mistral vector support (off the back of oai's) 2023-12-16 08:37:39 +10:00
Cohee
1b11ddc26a Add vector storage to WI scanning 2023-12-11 22:47:26 +02:00
Cohee
19df1f52cd Vector storage file retrieval 2023-11-30 00:01:59 +02:00
Cohee
5136b70882 #1355 Update summary settings button to make it more visible 2023-11-15 02:16:42 +02:00