1516 Commits

Author SHA1 Message Date
henk717
ccadeabbde
Merge pull request #99 from VE-FORBRYDERNE/model-patch
Model loading fixes
2022-03-13 11:10:15 +01:00
Gnome Ann
2b8c46338e Change current working directory to KoboldAI folder 2022-03-13 01:22:11 -05:00
Gnome Ann
48d07adb54 Also fallback to generic GPT2 tokenizer in Colab TPU instances 2022-03-12 23:19:35 -05:00
ebolam
8ae0a4a3e7 Online Services Working now (without a way to test as I don't have accounts) 2022-03-12 14:21:11 -05:00
henk717
d29a629320
Merge pull request #98 from ebolam/united
Fix for retry
2022-03-12 16:52:07 +01:00
ebolam
45eed78d21 Merge branch 'united' of https://github.com/ebolam/KoboldAI into united 2022-03-12 10:33:01 -05:00
ebolam
b55e5a8e0b Retry Bug Fix 2022-03-12 10:32:27 -05:00
henk717
2e1b3c82f9
Merge pull request #97 from ebolam/united
Fix for retry causing issues for future redo actions
2022-03-11 17:41:49 +01:00
ebolam
ae854bab3d Fix for retry causing issues for future redo actions 2022-03-11 11:40:55 -05:00
ebolam
772ae2eb80 Added model info to show model load progress in UI 2022-03-11 11:31:41 -05:00
henk717
2c66461c14
Merge pull request #96 from VE-FORBRYDERNE/dlpack
Use DLPack to convert PyTorch tensors to JAX arrays
2022-03-10 22:00:38 +01:00
Gnome Ann
a99eb8724d Use DLPack to convert PyTorch tensors to JAX arrays 2022-03-10 15:12:42 -05:00
henk717
b02d5e8696 Allows missing model_config again 2022-03-10 19:59:10 +01:00
henk717
172a548fa1 Fallback to generic GPT2 Tokenizer 2022-03-10 19:52:15 +01:00
henk717
68281184bf Remove Lowmem from TPU 2022-03-09 19:21:15 +01:00
henk717
9dee9b5c6d Ignore incorrect problems 2022-03-09 12:03:37 +01:00
henk717
a28e553412 Remove unused gettokenids 2022-03-09 11:59:33 +01:00
ebolam
0943926f6a Fix for lazy loading 2022-03-07 19:52:44 -05:00
ebolam
bfc07073e3 layer count fix 2022-03-07 19:33:24 -05:00
ebolam
d8ab58892d saved layer value fix 2022-03-07 19:21:55 -05:00
ebolam
da53d7edb3 Custom Path Load fix 2022-03-07 18:54:11 -05:00
ebolam
d1a64e25da Custom Model Load Fix 2022-03-07 18:44:37 -05:00
ebolam
70f1c2da9c Added stub for model name feedback 2022-03-07 14:20:25 -05:00
ebolam
d0553779ab Bug Fix 2022-03-07 12:33:35 -05:00
ebolam
6a08fe2f10 Added scroll bars to the model load menu 2022-03-07 12:04:41 -05:00
ebolam
c50fe77a7d Load Fix 2022-03-07 11:57:33 -05:00
ebolam
49fc854e55 Added saving of breakmodel values so that it defaults to it on next load 2022-03-07 11:49:34 -05:00
ebolam
2cf6b6e650
Merge branch 'henk717:united' into united 2022-03-07 11:31:14 -05:00
ebolam
123cd45b0e Breakmodel working now with the web UI 2022-03-07 11:27:23 -05:00
henk717
7434c9221b Expand OAI Setting Compatibility 2022-03-07 08:56:47 +01:00
ebolam
5e00f7daf0 Next evolution of web ui model selection. Custom Paths not working quite right. 2022-03-06 20:55:11 -05:00
ebolam
2ddf45141b Initial UI based model loading. Includes all parameters except breakmodel chunks, engine # for OAI, and url for ngrok url for google colab 2022-03-06 19:51:35 -05:00
ebolam
f6c95f18fa
Fix for Redo (#94)
* Corrected redo to skip blank steps (blank from "deleting" the chunk with the edit function)

* Removed debug code
2022-03-06 23:18:14 +01:00
henk717
f857696224 OAI ConfigName Bugfix 2022-03-06 20:18:42 +01:00
henk717
3ddc9647eb Basic GooseAI Support 2022-03-06 20:10:30 +01:00
henk717
f1b0ea711e
Merge branch 'KoboldAI:main' into united 2022-03-06 19:02:59 +01:00
henk717
932aabc2f3
Merge pull request #103 from henk717/main
Modern ROCm Docker
2022-03-06 19:02:38 +01:00
henk717
4332074c89 Modern ROCm Docker
Brings the ROCm container up to a modern standard in line with the CUDA docker.
2022-03-06 19:01:25 +01:00
henk717
4835192041 Load TK on demand 2022-03-06 14:12:01 +01:00
henk717
daea4b8d15 Fix Breakmodel RAM Regression 2022-03-06 08:26:50 +01:00
henk717
105d3831b5 Lazy Load Float32 for CPU 2022-03-06 07:56:04 +01:00
henk717
77cc2ee789
Merge pull request #93 from VE-FORBRYDERNE/lazy-loader
Lazy loader
2022-03-05 20:32:31 +01:00
Gnome Ann
373f7b9bd5 Don't convert tensors to float16 if using CPU-only mode 2022-03-05 14:30:26 -05:00
Gnome Ann
579e85820c Resolve merge conflict 2022-03-05 14:13:56 -05:00
Gnome Ann
2e19ea1bb6 Auto detect if we're in a Colab TPU instance 2022-03-05 14:07:23 -05:00
henk717
3a5793c815 No longer uses --colab_tpu 2022-03-05 19:58:24 +01:00
henk717
935c7e5786 Improved TPU support 2022-03-05 19:47:51 +01:00
henk717
6f2febb142
Merge pull request #92 from ebolam/united
Hopefully Last Redo Fix
2022-03-05 19:26:15 +01:00
ebolam
4a8d7f5e0b
Merge branch 'henk717:united' into united 2022-03-05 13:25:10 -05:00
henk717
c20435855b
Merge pull request #91 from VE-FORBRYDERNE/transformers-version-check
Put the XGLM embedding patch behind a version check
2022-03-05 19:03:00 +01:00