ebolam
69d942c00c
Kind of working breakmodel
2023-05-11 20:22:30 -04:00
Henk
33969b5845
Basic HF code execution support
2023-05-05 17:23:01 +02:00
Llama
3768848548
Fix tokenization and whitespace issues with llama-derived models
...
Work around the 'soft' prefix space behavior of sentencepiece.
Override encode to restore the deleted HF support for decode_with_prefix_space.
Override decode to skip the soft space and return true decoded tokens.
Allow submitting chat messages with embedded newlines.
Split sentences between punctuation and whitespace, rather than after whitespace.
Also include trailing quotes and brackets after sentence stoppers.
This avoids splitting ." and .) into two tokens, for instance.
Insert whitespace at the beginning of the author's note, since sentences are
split with leading whitespace.
Remove spurious newlines at the end of chat responses.
2023-05-03 01:27:11 -07:00
somebody
c95be636a4
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-05-01 17:08:20 -05:00
somebody
720b2ec7f0
Fix phantom variable
2023-04-27 19:05:38 -05:00
henk717
b0bbdc0c29
Merge pull request #333 from ebolam/united
...
New Editor
2023-04-27 15:52:13 +02:00
onesome
b8bef641ff
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-04-25 16:54:53 -05:00
Henk
560c8d23fb
Re-add UI Json Fix
2023-04-23 21:37:24 +02:00
Henk
b8cd5f4c03
Revert "Added comregex_ui and comregex_ai to the UI under other settings. Needs proper titles and descriptions still."
...
This reverts commit d16a3f4dc3
2023-04-23 21:35:24 +02:00
ebolam
3990e67b81
Merge commit 'refs/pull/378/head' of https://github.com/ebolam/KoboldAI into united
2023-04-21 08:27:36 -04:00
ebolam
d16a3f4dc3
Added comregex_ui and comregex_ai to the UI under other settings. Needs proper titles and descriptions still.
2023-04-16 21:02:42 -04:00
ebolam
fcba26f631
Fix for uploading files in UI2
2023-04-16 20:32:51 -04:00
Henk
b1d3a37fb0
<|comments|> now are [<|comments|>] to support OA
2023-04-16 19:31:17 +02:00
ebolam
348df9ddce
Remove bits and bytes check so it doesn't throw warning on windows
2023-04-15 10:12:20 -04:00
Concedo
9705b7b79c
increase API version (+1 squashed commits)
...
Squashed commits:
[c168c08
2023-04-15 18:09:53 +08:00
somebody
ea8df4c0d3
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-04-14 20:38:56 -05:00
ebolam
be0319cf03
added VERSION link in the left flyout menu footer that will show which git REPO and BRANCH the system is running on.
...
Fix for pasting text into the game area
Fix for ctrl+a then delete
Fix for changing text then back/forward a bunch loosing text
2023-04-14 13:54:11 -04:00
YellowRoseCx
ac98cd6dd1
add IP_whitelisting to koboldai_settings.py
2023-04-05 21:27:59 -05:00
somebody
4230fe4229
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-04-02 16:41:21 -05:00
somebody
864f9ed8c3
Add small debug for TPU
2023-03-17 17:06:48 -05:00
somebody
692dbfeb37
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-03-17 16:20:13 -05:00
jojorne
8378ff9e26
Fix typo
2023-03-14 04:20:32 -03:00
jojorne
8d5a581d5d
Enable renaming deleting wi root folder by creating a new one
2023-03-14 04:04:01 -03:00
henk717
db7b53f52d
Merge pull request #310 from nkpz/united
...
Fix out of range error after editing actions
2023-03-14 01:22:14 +01:00
henk717
5249045c35
Merge pull request #304 from YellowRoseCx/united-yr
...
added local rng_states variable and fixed minor typo
2023-03-13 22:46:00 +01:00
Nick Perez
0dce4c700f
Just reverse the range
2023-03-13 07:00:51 -04:00
Nick Perez
b4b24f1389
Fix out of range after deletion in for loop
2023-03-13 06:21:25 -04:00
jojorne
4b8d4cde7d
fix spacing
2023-03-12 20:41:34 -03:00
jojorne
4219e3e8d3
Removing the root folder is not supported
2023-03-12 20:38:58 -03:00
jojorne
e5c1b0506a
Renaming the root folder is not supported
2023-03-12 20:05:40 -03:00
jojorne
53f06903c2
revert more unrelated code
2023-03-11 13:54:01 -03:00
jojorne
c87ef60db1
revert more unrelated code
2023-03-11 13:48:41 -03:00
jojorne
e4ad8547a7
revert unrelated code
2023-03-11 13:39:19 -03:00
jojorne
47242e9abe
remove debug code
2023-03-11 13:21:22 -03:00
jojorne
423c022648
Fix save loading between v1 and v2 to v3 with wi features
2023-03-11 13:14:46 -03:00
YellowRoseCx
4371de2c11
added rng_states variable
...
added rng_states variable to fix an error caused by passing a seed through the API without having a seed already in use
2023-03-08 15:35:55 -06:00
somebody
dc3dd38c4e
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-03-07 17:02:28 -06:00
henk717
b307cdff57
Merge pull request #301 from jojorne/jojorne-patch-use-str-for-wi-keys
...
Access WI uid keys with str
2023-03-06 21:15:44 +01:00
Henk
099c818c06
Experimental unbanning of <>
2023-03-06 20:56:15 +01:00
Henk
b7f30a41c5
LLama tokenizer workaround
2023-03-06 19:32:28 +01:00
jojorne
4f17bf0c87
Access WI uid keys with str.
2023-03-05 13:22:33 -03:00
Henk
6857d2f7e1
Remove old worker API
2023-03-04 19:02:19 -06:00
Henk
1c891181e9
Remove old worker API
2023-03-04 18:27:02 +01:00
somebody
b99c16f562
Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv
2023-02-26 13:06:30 -06:00
Henk
cdfc7326e6
Horde API Setting Consolidation
2023-02-26 17:59:36 +01:00
somebody
ffe4f25349
Model: Work on stoppers and stuff
2023-02-25 17:12:16 -06:00
Henk
526e8ab9b1
More Horde setting fixing
2023-02-25 16:20:49 +01:00
Henk
29ceac6d43
Horde parameter fixes
2023-02-25 16:01:11 +01:00
Henk
b49070e3ed
Updated bridge for the new horde
2023-02-25 14:58:18 +01:00
jojorne
d3bedfcbda
Include koboldai_vars.save_story().
2023-02-22 15:42:56 -03:00
