Commit Graph

115 Commits

Author SHA1 Message Date
07fb92b37d Added vector secondary url placeholder example 2025-04-16 17:39:29 +05:00
f8bccb472f Adjusted naming and validation 2025-04-16 17:34:58 +05:00
bfe50403af Forgot semicolons 2025-04-16 16:45:01 +05:00
5cf3198da1 Added option to use secondary API URL in vector extension 2025-04-16 16:04:33 +05:00
78bda9954d Increase maximum injection depth and WI order (#3800) 2025-04-13 21:31:57 +03:00
70fe5b6e01 Add Gemini embedding model for vector storage 2025-04-01 21:42:26 +03:00
80e821d12d Add support for KoboldCpp embeddings in Vector Storage (#3795)
* Add support for KoboldCpp embeddings in vector processing

* Add validation for KoboldCpp embeddings to handle empty data

* Improve toast handling
2025-04-01 21:21:29 +03:00
1cb9287684 Vectors WebLLM (#3631)
* Add WebLLM support for vectorization

* Load models when WebLLM extension installed

* Consistency updated

* Move checkWebLlm to initEngine

* Refactor vector request handling to use getAdditionalArgs

* Add error handling for unsupported WebLLM extension

* Add prefix to error causes
2025-03-09 00:51:44 +02:00
58bbfc0d4e Add types for global translation function 2025-02-19 22:18:09 +02:00
058c86f3c1 Vectors: Don't use headers for source-specific fields in requests 2025-02-16 23:59:00 +02:00
f83dccda39 Mark 'Extras' option as deprecated in built-in extensions 2025-02-08 21:56:54 +02:00
1f9fa74786 Rewritten minLogLevel feature 2025-01-15 10:02:32 -05:00
89c984830b rename resultSize to count 2025-01-12 07:20:36 +13:00
fc5debc660 replaced returnChunks with return arg to use existing helper functions 2025-01-11 17:42:19 +13:00
7f5ce54b1f Add returnChunks and resultSize args to /db-search 2025-01-11 11:32:05 +13:00
77bee453ab Vectors: Add only custom boundary chunking 2025-01-03 20:44:25 +02:00
02900520c9 chore: Add index property to HashedMessage 2025-01-03 03:09:16 +02:00
eff4da42c5 Vector storage: skip for quiet prompts 2025-01-03 03:04:45 +02:00
2f5f9a437d Allow running generate interceptors on quiet prompts 2025-01-03 01:10:14 +02:00
378dfd3626 Vectors: escape file names 2024-11-18 15:24:26 +00:00
aaed09f606 Data Bank: display file ingestion progress 2024-11-18 15:18:45 +00:00
ba0d6bfa26 Vectors: fix force_chunk_delimiter value init 2024-10-16 07:53:53 +00:00
69283f511f Optimize summarization on query 2024-10-15 23:27:18 +03:00
e3de69a235 Add hash for getQueryText 2024-10-15 23:17:27 +03:00
65d3c2729a Fix typo in variable name 2024-10-15 23:14:59 +03:00
bb7e7b645d Add client side cacheing of vector summaries 2024-10-15 10:34:03 +07:00
1278b5c309 Fix character attachment content saving into settings.json 2024-10-03 22:13:37 +03:00
df3d7a048e Deprecate unscoped vectors 2024-09-24 21:51:10 +03:00
b2eab37a89 Adjust default extension prompts, remove square brackets 2024-09-22 12:58:46 +03:00
9ef3385255 Implement collection scopes for vector models (#2846)
* Implement collection scopes for vector models

* Update makersuite-vectors.js to use Gemini API text-embedding-004 model

* Add model scope for Google vectors

* Fix purge log

* Refactor header setting

* Fix typo

* Only display UI warning if scopes disabled

* Remove i18n attribute

---------

Co-authored-by: ceruleandeep <83318388+ceruleandeep@users.noreply.github.com>
2024-09-16 09:29:39 +03:00
06e3d5f8de Rename MakerSuite => AI Studio 2024-08-21 21:00:17 +03:00
c88edaa4ed Vector Storage: Fix query summarizing for WI and files 2024-08-16 20:49:14 +03:00
53c24174e7 Merge branch 'staging' into webgpu-summary 2024-08-13 20:54:46 +03:00
d0b368f29c Vector Storage: change NomicAI key input 2024-08-13 20:50:41 +03:00
4888e3c2b0 Vector Storage: summarize with WebLLM extension 2024-08-13 19:34:11 +03:00
c8b9b62d8a Update built-in extensions to use fixed order in extensions menu 2024-06-24 22:15:08 +03:00
8564d6faa8 Debug function to purge all vectors 2024-06-22 17:41:02 +03:00
b8830e34d3 Add ollama download shortcut to vector storage 2024-06-22 16:38:00 +03:00
bba16f5263 Custom vector chunk boundary 2024-06-16 02:16:27 +03:00
b22bc47c4f Update ext.macro calls in built-in extensions 2024-06-15 01:40:16 +03:00
3ede4aafbe Update zh-cn.json (#2376)
* Update zh-cn.json

* html changes

* `div`->`span`

* fixes

* fixes

* more fixes

* Revert last divs

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-06-14 22:46:40 +03:00
4e822eeebb Add VLLM as vector source 2024-06-09 01:03:22 +03:00
bcfc4d5c64 Split overlap size in two 2024-06-06 23:00:49 +03:00
39721b6a8f Add file chunks overlap control 2024-06-06 21:45:47 +03:00
716366070b Clamp /db-search threshold arg 2024-05-30 17:15:17 +03:00
2c911a3ea2 Add more Data Bank script commands 2024-05-30 14:49:57 +03:00
865c48bcc0 Cohee forgot the ABC 2024-05-28 22:57:07 +03:00
2b3dfc5ae2 Add ollama and llamacpp as vector sources 2024-05-28 22:54:50 +03:00
967a7980f5 Add vector retrieval score threshold 2024-05-23 17:28:43 +03:00
5147233391 Fix file attachment chunk size inconsistency 2024-05-13 00:27:32 +03:00