KoboldAI-Client/environments/huggingface.yml

name: koboldai
channels:
  - pytorch
  - conda-forge
  - defaults
dependencies:
  - colorama
  - flask-socketio=5.3.2
  - flask-session=0.4.0
  - python-socketio=5.7.2
  - pytorch=1.11.*
  - python=3.8.*
  - cudatoolkit=11.1
  - eventlet=0.33.3
  - dnspython=2.2.1
  - markdown
  - bleach=4.1.0
  - pip
  - git=2.35.1
  - sentencepiece
  - protobuf
  - marshmallow>=3.13
  - apispec-webframeworks
  - loguru
  - termcolor
  - psutil
  - pip:
    - flask-cloudflared==0.0.10
    - flask-ngrok
    - lupa==1.10
    - transformers==4.24.0
    - huggingface_hub==0.12.1
    - safetensors
    - accelerate
    - git+https://github.com/VE-FORBRYDERNE/mkultra
The Mamba Installer Update Big overhaul of the installer, partially based on the #53 commit from LexSong. The following is new : - Conda has been replaced with MicroMamba, allows the dependencies to automatically download the best version of Python and prevents all the issues with people failing to download conda. - The installer now has more options so you can choose not to delete the existing files, and it has new optional virtual K: drive support to bypass all the pathing issues people are having (Sorry Windows 7 users, its still not compatible even now). - Docker support for Linux systems has been added including ROCm support. - Environment files are now used to more easily keep everything on track, and to allow conda users to manually create environments across all operating systems (ROCm is an outlier in this because i have to use AMD's Pytorch docker for now it was to much hassle getting their Conda to use the environment file to add it to this commit). - Play.bat has been changed to allow the virtual drive support, everything should still be compatible with old installations as I kept all the paths intact. 2021-06-28 22:35:15 +02:00			`name: koboldai`
			`channels:`
			`- pytorch`
			`- conda-forge`
			`- defaults`
			`dependencies:`
			`- colorama`
SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00			`- flask-socketio=5.3.2`
			`- flask-session=0.4.0`
			`- python-socketio=5.7.2`
Torch version changes 2022-03-17 21:11:36 +01:00			`- pytorch=1.11.*`
Revert to Python 3.8 tensorflow-base doesn't like the older cudatoolkit anymore. The one for python 3.8 still does, so lets just stick to that for now then. 2021-09-16 01:18:04 +02:00			`- python=3.8.*`
Dependency Fixes Looks like cudatoolkit is now shipping 11.3, but pytorch has no version for this resulting in an installation of the CPU only version. This is going to lead to people unable to get their GPU running, so for now we force the recommended 11.1 version. I also don't see any harm in allowing Python 3.9 so thats now the default as well to prevent future issues. 2021-09-16 01:07:43 +02:00			`- cudatoolkit=11.1`
SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00			`- eventlet=0.33.3`
DNSPython workaround DNSPython had an update eventlet is not ready for. We now manually cap DNSPython to ensure the installations still happen correctly. 2023-01-16 16:32:17 +01:00			`- dnspython=2.2.1`
Welcome Message API Allows model creators to customize the welcome message using Markdown and Limited HTML Existing United users need to run install_requirements..bat again, you can leave the existing dependencies intact. 2022-01-30 19:47:30 +01:00			`- markdown`
Cap Bleach version to 4.1.0 2022-04-12 10:32:27 +02:00			`- bleach=4.1.0`
Added --remote Mode First step towards native Colab support, built in Cloudflare tunnels easily allows players to play KoboldAI on another device. This mode also removes buttons that would get you stuck if you have no local PC access. 2021-08-20 00:37:59 +02:00			`- pip`
Cap GIT version for now 2022-04-27 18:20:43 +02:00			`- git=2.35.1`
Dependencies required for newer models 2022-02-21 21:17:12 +01:00			`- sentencepiece`
			`- protobuf`
Upload basic API with /generate POST endpoint 2022-08-08 08:27:48 +02:00			`- marshmallow>=3.13`
			`- apispec-webframeworks`
loguru dependency in all environments 2022-09-16 00:52:15 +02:00			`- loguru`
Tuner Dependencies 2022-10-22 19:00:06 +02:00			`- termcolor`
Dependency improvements Adding psutil from conda to avoid the need for a compiler, finetuneanon should no longer be used. If people really want to use it they are on their own. 2022-11-11 21:13:51 +01:00			`- psutil`
Added --remote Mode First step towards native Colab support, built in Cloudflare tunnels easily allows players to play KoboldAI on another device. This mode also removes buttons that would get you stuck if you have no local PC access. 2021-08-20 00:37:59 +02:00			`- pip:`
Pin Flask-cloudflared 2023-02-10 19:11:13 +01:00			`- flask-cloudflared==0.0.10`
Update dependencies Updates dependencies, play.sh didn't work properly so removing that for now since manually running aiserver.py is superior on Linux until I can get conda to init inside the script 2021-12-09 23:49:35 +01:00			`- flask-ngrok`
Use eventlet instead of gevent-websocket 2021-12-13 23:19:04 +01:00			`- lupa==1.10`
Pin transformers version To avoid breaking changes lets force the exact transformers version we code against. This will be automatically picked up by all the automatic updaters. 2022-12-02 01:48:12 +01:00			`- transformers==4.24.0`
Huggingface Hub Pin 2023-03-08 18:03:36 +01:00			`- huggingface_hub==0.12.1`
Add Safetensors Having the dependency adds basic support for safetensor models. 2023-01-06 16:40:56 +01:00			`- safetensors`
Upload basic API with /generate POST endpoint 2022-08-08 08:27:48 +02:00			`- accelerate`
Tuner Dependencies 2022-10-22 19:00:06 +02:00			`- git+https://github.com/VE-FORBRYDERNE/mkultra`