KoboldAI-Client/environments/rocm.yml

name: koboldai
channels:
  - conda-forge
  - defaults
dependencies:
  - colorama
  - flask=2.2.3
  - flask-socketio=5.3.2
  - flask-session=0.4.0
  - python-socketio=5.7.2
  - python=3.8.*
  - eventlet=0.33.3
  - dnspython=2.2.1
  - markdown
  - bleach=4.1.0
  - pip
  - git=2.35.1
  - sentencepiece
  - protobuf
  - marshmallow>=3.13
  - apispec-webframeworks
  - loguru
  - termcolor
  - psutil
  - pip:
    - --extra-index-url https://download.pytorch.org/whl/rocm5.1.1
    - torch==1.12.1+rocm5.1.1
    - flask-cloudflared==0.0.10
    - flask-ngrok
    - lupa==1.10
    - transformers==4.24.0
    - huggingface_hub==0.12.1
    - safetensors
    - accelerate
    - git+https://github.com/VE-FORBRYDERNE/mkultra
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`name: koboldai`
			`channels:`
			`- conda-forge`
			`- defaults`
			`dependencies:`
			`- colorama`
Flask fix 2023-04-29 02:44:41 +02:00			`- flask=2.2.3`
SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00			`- flask-socketio=5.3.2`
			`- flask-session=0.4.0`
			`- python-socketio=5.7.2`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- python=3.8.*`
SocketIO Requirements Pin 2023-03-17 01:28:59 +01:00			`- eventlet=0.33.3`
DNSPython workaround DNSPython had an update eventlet is not ready for. We now manually cap DNSPython to ensure the installations still happen correctly. 2023-01-16 16:32:17 +01:00			`- dnspython=2.2.1`
Welcome Message API Allows model creators to customize the welcome message using Markdown and Limited HTML Existing United users need to run install_requirements..bat again, you can leave the existing dependencies intact. 2022-01-30 19:47:30 +01:00			`- markdown`
Cap Bleach version to 4.1.0 2022-04-12 10:32:27 +02:00			`- bleach=4.1.0`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- pip`
Cap GIT version for now 2022-04-27 18:20:43 +02:00			`- git=2.35.1`
Dependencies required for newer models 2022-02-21 21:17:12 +01:00			`- sentencepiece`
			`- protobuf`
Upload basic API with /generate POST endpoint 2022-08-08 08:27:48 +02:00			`- marshmallow>=3.13`
			`- apispec-webframeworks`
loguru dependency in all environments 2022-09-16 00:52:15 +02:00			`- loguru`
Tuner Dependencies 2022-10-22 19:00:06 +02:00			`- termcolor`
Dependency improvements Adding psutil from conda to avoid the need for a compiler, finetuneanon should no longer be used. If people really want to use it they are on their own. 2022-11-11 21:13:51 +01:00			`- psutil`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- pip:`
Requirements Updates 2022-09-25 19:33:18 +02:00			`- --extra-index-url https://download.pytorch.org/whl/rocm5.1.1`
ROCm Dependency Bump/Fix 2023-01-13 22:49:32 +01:00			`- torch==1.12.1+rocm5.1.1`
Pin Flask-cloudflared 2023-02-10 19:11:13 +01:00			`- flask-cloudflared==0.0.10`
Migrate to official transformers No longer using VE's fork since its obsolete, in line with what we already did for the CUDA varient. 2021-12-07 23:35:28 +01:00			`- flask-ngrok`
Use eventlet instead of gevent-websocket 2021-12-13 23:19:04 +01:00			`- lupa==1.10`
Typo fix 2022-12-08 15:17:10 +01:00			`- transformers==4.24.0`
Huggingface Hub Pin 2023-03-08 18:03:36 +01:00			`- huggingface_hub==0.12.1`
Add Safetensors Having the dependency adds basic support for safetensor models. 2023-01-06 16:40:56 +01:00			`- safetensors`
Require accelerate Transformers 4.20 now requires accelerate to be installed for some of the features we use in KoboldAI. This is now a required dependency for updated users. 2022-06-16 20:38:58 +02:00			`- accelerate`
Tuner Dependencies 2022-10-22 19:00:06 +02:00			`- git+https://github.com/VE-FORBRYDERNE/mkultra`