Commit Graph

91 Commits

Author SHA1 Message Date
1cb9287684 Vectors WebLLM (#3631)
* Add WebLLM support for vectorization

* Load models when WebLLM extension installed

* Consistency updated

* Move checkWebLlm to initEngine

* Refactor vector request handling to use getAdditionalArgs

* Add error handling for unsupported WebLLM extension

* Add prefix to error causes
2025-03-09 00:51:44 +02:00
58bbfc0d4e Add types for global translation function 2025-02-19 22:18:09 +02:00
058c86f3c1 Vectors: Don't use headers for source-specific fields in requests 2025-02-16 23:59:00 +02:00
1f9fa74786 Rewritten minLogLevel feature 2025-01-15 10:02:32 -05:00
89c984830b rename resultSize to count 2025-01-12 07:20:36 +13:00
fc5debc660 replaced returnChunks with return arg to use existing helper functions 2025-01-11 17:42:19 +13:00
7f5ce54b1f Add returnChunks and resultSize args to /db-search 2025-01-11 11:32:05 +13:00
77bee453ab Vectors: Add only custom boundary chunking 2025-01-03 20:44:25 +02:00
02900520c9 chore: Add index property to HashedMessage 2025-01-03 03:09:16 +02:00
eff4da42c5 Vector storage: skip for quiet prompts 2025-01-03 03:04:45 +02:00
2f5f9a437d Allow running generate interceptors on quiet prompts 2025-01-03 01:10:14 +02:00
378dfd3626 Vectors: escape file names 2024-11-18 15:24:26 +00:00
aaed09f606 Data Bank: display file ingestion progress 2024-11-18 15:18:45 +00:00
ba0d6bfa26 Vectors: fix force_chunk_delimiter value init 2024-10-16 07:53:53 +00:00
69283f511f Optimize summarization on query 2024-10-15 23:27:18 +03:00
e3de69a235 Add hash for getQueryText 2024-10-15 23:17:27 +03:00
65d3c2729a Fix typo in variable name 2024-10-15 23:14:59 +03:00
bb7e7b645d Add client side cacheing of vector summaries 2024-10-15 10:34:03 +07:00
1278b5c309 Fix character attachment content saving into settings.json 2024-10-03 22:13:37 +03:00
df3d7a048e Deprecate unscoped vectors 2024-09-24 21:51:10 +03:00
b2eab37a89 Adjust default extension prompts, remove square brackets 2024-09-22 12:58:46 +03:00
9ef3385255 Implement collection scopes for vector models (#2846)
* Implement collection scopes for vector models

* Update makersuite-vectors.js to use Gemini API text-embedding-004 model

* Add model scope for Google vectors

* Fix purge log

* Refactor header setting

* Fix typo

* Only display UI warning if scopes disabled

* Remove i18n attribute

---------

Co-authored-by: ceruleandeep <83318388+ceruleandeep@users.noreply.github.com>
2024-09-16 09:29:39 +03:00
c88edaa4ed Vector Storage: Fix query summarizing for WI and files 2024-08-16 20:49:14 +03:00
53c24174e7 Merge branch 'staging' into webgpu-summary 2024-08-13 20:54:46 +03:00
d0b368f29c Vector Storage: change NomicAI key input 2024-08-13 20:50:41 +03:00
4888e3c2b0 Vector Storage: summarize with WebLLM extension 2024-08-13 19:34:11 +03:00
c8b9b62d8a Update built-in extensions to use fixed order in extensions menu 2024-06-24 22:15:08 +03:00
8564d6faa8 Debug function to purge all vectors 2024-06-22 17:41:02 +03:00
b8830e34d3 Add ollama download shortcut to vector storage 2024-06-22 16:38:00 +03:00
bba16f5263 Custom vector chunk boundary 2024-06-16 02:16:27 +03:00
b22bc47c4f Update ext.macro calls in built-in extensions 2024-06-15 01:40:16 +03:00
4e822eeebb Add VLLM as vector source 2024-06-09 01:03:22 +03:00
bcfc4d5c64 Split overlap size in two 2024-06-06 23:00:49 +03:00
39721b6a8f Add file chunks overlap control 2024-06-06 21:45:47 +03:00
716366070b Clamp /db-search threshold arg 2024-05-30 17:15:17 +03:00
2c911a3ea2 Add more Data Bank script commands 2024-05-30 14:49:57 +03:00
2b3dfc5ae2 Add ollama and llamacpp as vector sources 2024-05-28 22:54:50 +03:00
967a7980f5 Add vector retrieval score threshold 2024-05-23 17:28:43 +03:00
5147233391 Fix file attachment chunk size inconsistency 2024-05-13 00:27:32 +03:00
d9d76ba16d #2164 Add error toasts to VecStore 2024-04-30 00:17:39 +03:00
6ac6c7cfda #2159 Move debounce constants to a separate module 2024-04-28 19:47:53 +03:00
de2bb7938a Utilize import for vector store 2024-04-28 14:35:35 +03:00
d7ade487b8 Refactor common enum for debounce timeouts 2024-04-28 06:21:47 +02:00
75372ad0cc Use Map for caches instead of objects 2024-04-23 16:15:54 +03:00
4370db6bdc Implement World Info activation using Vector Storage 2024-04-23 03:09:52 +03:00
ca89be8930 Add experimental setting for file translation 2024-04-21 03:24:01 +03:00
a3f6ce52e4 Fix manual vectorization of files 2024-04-19 18:43:35 +03:00
80de3fdd4c Add buttons to process and purge file vectors for current chat 2024-04-19 00:16:23 +03:00
25cb598694 Add Cohere as embedding source 2024-04-19 00:07:12 +03:00
2eafa2a212 Clean-up vectors upon deleting a file from Data Bank 2024-04-18 23:07:16 +03:00