Commit Graph

77 Commits

Author SHA1 Message Date
Cohee bba16f5263 Custom vector chunk boundary 2024-06-16 02:16:27 +03:00
Cohee b22bc47c4f Update ext.macro calls in built-in extensions 2024-06-15 01:40:16 +03:00
steve green 3ede4aafbe
Update zh-cn.json (#2376)
* Update zh-cn.json

* html changes

* `div`->`span`

* fixes

* fixes

* more fixes

* Revert last divs

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-06-14 22:46:40 +03:00
Cohee 4e822eeebb Add VLLM as vector source 2024-06-09 01:03:22 +03:00
Cohee bcfc4d5c64 Split overlap size in two 2024-06-06 23:00:49 +03:00
Cohee 39721b6a8f Add file chunks overlap control 2024-06-06 21:45:47 +03:00
Cohee 716366070b Clamp /db-search threshold arg 2024-05-30 17:15:17 +03:00
Cohee 2c911a3ea2 Add more Data Bank script commands 2024-05-30 14:49:57 +03:00
Cohee 865c48bcc0 Cohee forgot the ABC 2024-05-28 22:57:07 +03:00
Cohee 2b3dfc5ae2 Add ollama and llamacpp as vector sources 2024-05-28 22:54:50 +03:00
Cohee 967a7980f5 Add vector retrieval score threshold 2024-05-23 17:28:43 +03:00
Cohee 5147233391 Fix file attachment chunk size inconsistency 2024-05-13 00:27:32 +03:00
Cohee d9d76ba16d #2164 Add error toasts to VecStore 2024-04-30 00:17:39 +03:00
Cohee 6ac6c7cfda #2159 Move debounce constants to a separate module 2024-04-28 19:47:53 +03:00
Cohee de2bb7938a Utilize import for vector store 2024-04-28 14:35:35 +03:00
Wolfsblvt d7ade487b8 Refactor common enum for debounce timeouts 2024-04-28 06:21:47 +02:00
Cohee 75372ad0cc Use Map for caches instead of objects 2024-04-23 16:15:54 +03:00
Cohee 4370db6bdc Implement World Info activation using Vector Storage 2024-04-23 03:09:52 +03:00
Cohee ca89be8930 Add experimental setting for file translation 2024-04-21 03:24:01 +03:00
Cohee a3f6ce52e4 Fix manual vectorization of files 2024-04-19 18:43:35 +03:00
Cohee 80de3fdd4c Add buttons to process and purge file vectors for current chat 2024-04-19 00:16:23 +03:00
Cohee 25cb598694 Add Cohere as embedding source 2024-04-19 00:07:12 +03:00
Cohee 2eafa2a212 Clean-up vectors upon deleting a file from Data Bank 2024-04-18 23:07:16 +03:00
Cohee 8434f6e6cf Clear toast upon inserting file 2024-04-18 22:59:42 +03:00
Cohee 16785ae005 Merge branch 'staging' into neo-server 2024-04-18 22:57:27 +03:00
Cohee 5e18b1872b Hide vector summarization unless chat vectors is enabled 2024-04-18 22:32:01 +03:00
Kristan Schlikow abd8acd9fc
Add experimental flask icon with title 2024-04-17 20:35:51 +02:00
Kristan Schlikow 977c1d4ac4
Add missing hr to the settings html 2024-04-17 20:35:51 +02:00
Kristan Schlikow 21b5bb5a29
Rearrange settings 2024-04-17 20:35:51 +02:00
Kristan Schlikow 10692523f0
Improve settings, add settings for prompt, sent message summarize toggle 2024-04-17 20:35:50 +02:00
Kristan Schlikow a022c9eccb
Set css class for summary dropdown in vectors 2024-04-17 20:35:50 +02:00
Kristan Schlikow 4cfd0c71cf
Add extras summarization API, fix missing substitution of placeholders 2024-04-17 20:35:49 +02:00
Kristan Schlikow a1473dedd0
Make summarization toggleable 2024-04-17 20:35:49 +02:00
Kristan Schlikow 59abee3043
Summarize the chat messages handed to the embedding beforehand 2024-04-17 20:35:48 +02:00
Cohee 9a1ea7f226 Implement Data Bank vectors querying 2024-04-17 02:09:22 +03:00
Cohee 4665db62f4 #1954 Remove backtick wrapping for inserted files 2024-04-16 22:28:10 +03:00
Cohee 123131074c Change built-in extensions template render to async 2024-04-11 23:38:44 +03:00
Cohee 5efdecc825 Add new OpenAI embedding models for selection 2024-03-12 21:41:30 +02:00
Kristian Schlikow 44a7dd3d74
Add NomicAI for vectorization (#1922)
* Crudely add NomicAi for vectorization

* Move NomicAI to its own endpoint, properly handle API key

* Adjust clear button html

* Remove leftover nomicai http header code

* Revert changes to openai-vectors.js

* Fix UI issues

* Revert change to settings, fix UI

---------

Co-authored-by: Cohee <18619528+Cohee1207@users.noreply.github.com>
2024-03-12 21:10:25 +02:00
Cohee b490978142 Refactor vector models code 2024-03-02 23:16:18 +02:00
Kristan Schlikow adfb9c5097
Implement TogetherAI as vectorization provider 2024-03-01 23:52:49 +01:00
Cohee 7b8ac8f4c4 Properly use vector insert setting 2024-02-24 15:57:26 +02:00
Cohee 737a0bd3ae Fix purge extras and mistral vectors 2024-02-23 22:37:00 +02:00
Cohee f732b8ae4c Add optional module to vectors manifest 2024-01-27 23:09:41 +02:00
Cohee 3cf01e765a #1741 Filter non-unique chunks 2024-01-26 04:18:15 +02:00
Juha Jeronen 0683d7a538 Merge branch 'staging' into tooltips-vol1 2024-01-24 17:05:09 +02:00
Cohee 0ad756c923 Add check for "embeddings" module. 2024-01-24 16:51:57 +02:00
Juha Jeronen 8b43535352 Initial support for Extras vectorizer, for Vector Storage 2024-01-24 15:16:55 +02:00
Juha Jeronen 6a03980db6 add/improve tooltips 2024-01-22 15:56:12 +02:00
Cohee a2e4dc2950 Add chunking of vector storage messages 2023-12-31 04:00:04 +02:00