103 Commits

Author SHA1 Message Date
zerofata
89c984830b
rename resultSize to count 2025-01-12 07:20:36 +13:00
zerofata
fc5debc660
replaced returnChunks with return arg to use existing helper functions 2025-01-11 17:42:19 +13:00
zerofata
7f5ce54b1f
Add returnChunks and resultSize args to /db-search 2025-01-11 11:32:05 +13:00
Cohee
77bee453ab Vectors: Add only custom boundary chunking 2025-01-03 20:44:25 +02:00
Cohee
02900520c9 chore: Add index property to HashedMessage 2025-01-03 03:09:16 +02:00
Cohee
eff4da42c5 Vector storage: skip for quiet prompts 2025-01-03 03:04:45 +02:00
Cohee
2f5f9a437d Allow running generate interceptors on quiet prompts 2025-01-03 01:10:14 +02:00
Cohee
378dfd3626 Vectors: escape file names 2024-11-18 15:24:26 +00:00
Cohee
aaed09f606 Data Bank: display file ingestion progress 2024-11-18 15:18:45 +00:00
Cohee
ba0d6bfa26 Vectors: fix force_chunk_delimiter value init 2024-10-16 07:53:53 +00:00
Cohee
69283f511f Optimize summarization on query 2024-10-15 23:27:18 +03:00
Cohee
e3de69a235 Add hash for getQueryText 2024-10-15 23:17:27 +03:00
Cohee
65d3c2729a Fix typo in variable name 2024-10-15 23:14:59 +03:00
QuantumEntangledAndy
bb7e7b645d
Add client side cacheing of vector summaries 2024-10-15 10:34:03 +07:00
Cohee
1278b5c309 Fix character attachment content saving into settings.json 2024-10-03 22:13:37 +03:00
Cohee
df3d7a048e Deprecate unscoped vectors 2024-09-24 21:51:10 +03:00
Cohee
b2eab37a89 Adjust default extension prompts, remove square brackets 2024-09-22 12:58:46 +03:00
Cohee
9ef3385255
Implement collection scopes for vector models (#2846)
* Implement collection scopes for vector models

* Update makersuite-vectors.js to use Gemini API text-embedding-004 model

* Add model scope for Google vectors

* Fix purge log

* Refactor header setting

* Fix typo

* Only display UI warning if scopes disabled

* Remove i18n attribute

---------

Co-authored-by: ceruleandeep <83318388+ceruleandeep@users.noreply.github.com>
2024-09-16 09:29:39 +03:00
Cohee
06e3d5f8de Rename MakerSuite => AI Studio 2024-08-21 21:00:17 +03:00
Cohee
c88edaa4ed Vector Storage: Fix query summarizing for WI and files 2024-08-16 20:49:14 +03:00
Cohee
53c24174e7 Merge branch 'staging' into webgpu-summary 2024-08-13 20:54:46 +03:00
Cohee
d0b368f29c Vector Storage: change NomicAI key input 2024-08-13 20:50:41 +03:00
Cohee
4888e3c2b0 Vector Storage: summarize with WebLLM extension 2024-08-13 19:34:11 +03:00
Cohee
c8b9b62d8a Update built-in extensions to use fixed order in extensions menu 2024-06-24 22:15:08 +03:00
Cohee
8564d6faa8 Debug function to purge all vectors 2024-06-22 17:41:02 +03:00
Cohee
b8830e34d3 Add ollama download shortcut to vector storage 2024-06-22 16:38:00 +03:00
Cohee
bba16f5263 Custom vector chunk boundary 2024-06-16 02:16:27 +03:00
Cohee
b22bc47c4f Update ext.macro calls in built-in extensions 2024-06-15 01:40:16 +03:00
steve green
3ede4aafbe
Update zh-cn.json (#2376)
* Update zh-cn.json

* html changes

* `div`->`span`

* fixes

* fixes

* more fixes

* Revert last divs

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-06-14 22:46:40 +03:00
Cohee
4e822eeebb Add VLLM as vector source 2024-06-09 01:03:22 +03:00
Cohee
bcfc4d5c64 Split overlap size in two 2024-06-06 23:00:49 +03:00
Cohee
39721b6a8f Add file chunks overlap control 2024-06-06 21:45:47 +03:00
Cohee
716366070b Clamp /db-search threshold arg 2024-05-30 17:15:17 +03:00
Cohee
2c911a3ea2 Add more Data Bank script commands 2024-05-30 14:49:57 +03:00
Cohee
865c48bcc0 Cohee forgot the ABC 2024-05-28 22:57:07 +03:00
Cohee
2b3dfc5ae2 Add ollama and llamacpp as vector sources 2024-05-28 22:54:50 +03:00
Cohee
967a7980f5 Add vector retrieval score threshold 2024-05-23 17:28:43 +03:00
Cohee
5147233391 Fix file attachment chunk size inconsistency 2024-05-13 00:27:32 +03:00
Cohee
d9d76ba16d #2164 Add error toasts to VecStore 2024-04-30 00:17:39 +03:00
Cohee
6ac6c7cfda #2159 Move debounce constants to a separate module 2024-04-28 19:47:53 +03:00
Cohee
de2bb7938a Utilize import for vector store 2024-04-28 14:35:35 +03:00
Wolfsblvt
d7ade487b8 Refactor common enum for debounce timeouts 2024-04-28 06:21:47 +02:00
Cohee
75372ad0cc Use Map for caches instead of objects 2024-04-23 16:15:54 +03:00
Cohee
4370db6bdc Implement World Info activation using Vector Storage 2024-04-23 03:09:52 +03:00
Cohee
ca89be8930 Add experimental setting for file translation 2024-04-21 03:24:01 +03:00
Cohee
a3f6ce52e4 Fix manual vectorization of files 2024-04-19 18:43:35 +03:00
Cohee
80de3fdd4c Add buttons to process and purge file vectors for current chat 2024-04-19 00:16:23 +03:00
Cohee
25cb598694 Add Cohere as embedding source 2024-04-19 00:07:12 +03:00
Cohee
2eafa2a212 Clean-up vectors upon deleting a file from Data Bank 2024-04-18 23:07:16 +03:00
Cohee
8434f6e6cf Clear toast upon inserting file 2024-04-18 22:59:42 +03:00