rixty/KoboldAI-Client
1
1
Fork 0
mirror of https://github.com/KoboldAI/KoboldAI-Client.git synced 2025-06-05 21:59:24 +02:00
Code Issues Projects Releases Wiki Activity
3,874 Commits 1 Branch 5 Tags
d496e861f4ab3f6c05e4d92bc9e29e84511cd87d
Commit Graph

126 Commits

Author SHA1 Message Date
onesome
d496e861f4 Undo pretty code because I haven't cracked the jax enigma yet 2023-04-25 21:11:49 -05:00
onesome
b8bef641ff Merge branch 'united' of https://github.com/henk717/KoboldAI into model-structure-and-maybe-rwkv 2023-04-25 16:54:53 -05:00
henk717
8f44141f96 Pin driver to the one from JAX 0.3.25 2023-04-23 01:43:37 +02:00
Bogdan Drema
4502a3f6b8 Fix: TPU driver error 
to_dlpack/from_dlpack was causing issues with tensor with new jax version
 2023-04-22 22:31:21 +01:00
somebody
9d70646e4d Lazyload: Safetensors 2023-04-02 15:40:34 -05:00
somebody
adc11fdbc9 TPUMTJ: Fix loading bar 
I don't know why it works but I know it works
 2023-03-13 20:13:05 -05:00
somebody
38c4edac40 Model: Fix eos/bos padding issue 
Weird config None assignments
 2023-03-10 20:01:01 -06:00
somebody
3a128e76b4 Attempts at dynamic wi fixes 2023-03-07 16:33:23 -06:00
somebody
54cecd4d5d Model: And another refactor 2023-03-01 19:16:35 -06:00
somebody
ef1155291f Model: TPU Fixes 2023-02-28 18:05:34 -06:00
somebody
ed83362dee Model: TPU should be ready for testing 2023-02-27 19:08:44 -06:00
somebody
af73527be0 Samplers: Part 2 2023-02-26 17:22:54 -06:00
somebody
10842e964b Get rid of yet another instance of this identical class 2023-02-26 14:02:15 -06:00
Henk
a80027384d Revert 'Arg Revision Workaround for TPU' 
Turns out that file doesn't have access to arg, reverting. TPU revision support will have to wait until we have the proper value fixed.
 2023-01-31 19:16:00 +01:00
Henk
e555a70a38 Arg Revision Workaround for TPU 2023-01-31 18:54:48 +01:00
ebolam
9b1138bafa Added in alternative rep pen calculation (log instead of linear application) as an option. 2023-01-10 08:45:55 -05:00
ebolam
1500d07c38 Merge commit 'refs/pull/352/head' of https://github.com/ebolam/KoboldAI into UI2 2022-12-20 21:24:06 -05:00
Henk
eeb1774d42 Cleaner implementation of zipfolder 2022-12-10 19:23:08 +01:00
Henk
9a8e8a0005 New pytorch zipfile support 2022-12-10 19:11:07 +01:00
ebolam
c1cea71ed6 Merge commit 'refs/pull/331/head' of https://github.com/ebolam/KoboldAI into UI2 2022-12-07 12:04:42 -05:00
vfbd
9a3f0eaab2 Only enable TPU transpose optimization if loading from HF model 2022-11-21 13:47:18 -05:00
Henk
eb52ebd082 Merge branch 'main' into united 2022-11-03 00:22:30 +01:00
vfbd
b20d80ca2a Add vocab padding to embedding bias in gptj.json 2022-11-02 19:02:09 -04:00
ebolam
c3ccdb0b50 Potential Colab URL fix 2022-10-28 14:19:50 -04:00
ebolam
c3180fb06f Move display of Colab link to later in the load process for TPUs 2022-10-25 09:41:59 -04:00
ebolam
c83642dbbc Better Colab status. Disconnects due to long running something still 2022-10-24 20:43:34 -04:00
ebolam
405578f2b3 Colab Update 2022-10-24 20:28:56 -04:00
ebolam
25dbe7ff81 Colab Fixes 2022-10-24 19:40:09 -04:00
ebolam
c2eadcddf6 Typo 2022-10-24 19:33:28 -04:00
ebolam
c1df2c7862 Colab Fix 2022-10-24 19:32:17 -04:00
ebolam
693e7500cf Debug 2022-10-24 19:28:56 -04:00
ebolam
f0dfde9a64 Colab debug 2022-10-24 19:27:48 -04:00
ebolam
1950eb6b4f Colab Debug 2022-10-24 19:18:40 -04:00
ebolam
db2fbbb17a Colab Debug 2022-10-24 19:16:03 -04:00
ebolam
46ac4ec009 Slight fix 2022-10-24 19:01:11 -04:00
ebolam
47c832fde4 Add Original UI status for TPU connection/loading 2022-10-24 18:52:53 -04:00
ebolam
b01713875c Add status bar message and status bar for TPU loading 2022-10-24 18:34:45 -04:00
ebolam
e101e43132 Merge commit 'refs/pull/243/head' of https://github.com/ebolam/KoboldAI into UI2 2022-10-23 12:03:40 -04:00
ebolam
0a81727fc2 Merge commit 'refs/pull/227/head' of https://github.com/ebolam/KoboldAI into UI2 2022-10-19 10:32:04 -04:00
vfbd
bdc73ef393 Decrease TPU loading times by eliminating a transpose operation 2022-10-12 14:31:18 -04:00
ebolam
dfb05968c9 Merge commit 'refs/pull/188/head' of https://github.com/ebolam/KoboldAI into UI2 2022-10-07 14:31:59 -04:00
vfbd
323f593a96 Custom unpickler to avoid pickle's arbitrary code execution vulnerability 2022-10-06 20:08:08 -04:00
vfbd
bdfa6d86b7 Seed has to be a 64-bit unsigned int or PyTorch will throw an error 
tpu_mtj_backend's seed can be an integer of arbitrary size but we will
limit it to a 64-bit unsigned integer anyways for consistency.
 2022-10-02 17:50:32 -04:00
vfbd
1a59a4acea Allow changing sampler seed and sampler order from API 2022-10-02 16:25:51 -04:00
ebolam
c28ad27c1d Merge commit 'refs/pull/181/head' of https://github.com/ebolam/KoboldAI into UI2 2022-09-28 12:59:53 -04:00
Henk
6c32bc18d7 GPT2Tokenizer for TPU 2022-09-27 18:33:31 +02:00
Henk
11455697ef Tokenizer Fixes (Slow first to keep coherency) 2022-09-27 17:57:18 +02:00
Henk
07896867b2 Revert Tokenizer Change 2022-09-27 15:36:08 +02:00
Henk
82a250aa1b Revert "Fix tokenizer selection code" 
This reverts commit 7fba1fd28a.
 2022-09-27 15:33:08 +02:00
ebolam
3afd617cb4 Merge commit 'refs/pull/179/head' of https://github.com/ebolam/KoboldAI into UI2 2022-09-27 08:21:05 -04:00