KoboldAI-Client/environments/rocm.yml

name: koboldai
channels:
  - conda-forge
  - defaults
dependencies:
  - colorama
  - flask-socketio
  - flask-session
  - python=3.8.*
  - eventlet
  - markdown
  - bleach=4.1.0
  - pip
  - git=2.35.1
  - sentencepiece
  - protobuf
  - marshmallow>=3.13
  - apispec-webframeworks
  - loguru
  - termcolor
  - psutil
  - pip:
    - --extra-index-url https://download.pytorch.org/whl/rocm5.1.1
    - torch==1.11.*
    - flask-cloudflared
    - flask-ngrok
    - lupa==1.10
    - transformers==4.24.0
    - huggingface_hub>=0.10.1
    - safetensors
    - accelerate
    - git+https://github.com/VE-FORBRYDERNE/mkultra
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`name: koboldai`
			`channels:`
			`- conda-forge`
			`- defaults`
			`dependencies:`
			`- colorama`
			`- flask-socketio`
flask-session for conda 2022-07-04 20:07:11 +02:00			`- flask-session`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- python=3.8.*`
Use eventlet instead of gevent-websocket 2021-12-13 23:19:04 +01:00			`- eventlet`
Welcome Message API Allows model creators to customize the welcome message using Markdown and Limited HTML Existing United users need to run install_requirements..bat again, you can leave the existing dependencies intact. 2022-01-30 19:47:30 +01:00			`- markdown`
Cap Bleach version to 4.1.0 2022-04-12 10:32:27 +02:00			`- bleach=4.1.0`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- pip`
Cap GIT version for now 2022-04-27 18:20:43 +02:00			`- git=2.35.1`
Dependencies required for newer models 2022-02-21 21:17:12 +01:00			`- sentencepiece`
			`- protobuf`
Upload basic API with /generate POST endpoint 2022-08-08 08:27:48 +02:00			`- marshmallow>=3.13`
			`- apispec-webframeworks`
loguru dependency in all environments 2022-09-16 00:52:15 +02:00			`- loguru`
Tuner Dependencies 2022-10-22 19:00:06 +02:00			`- termcolor`
Dependency improvements Adding psutil from conda to avoid the need for a compiler, finetuneanon should no longer be used. If people really want to use it they are on their own. 2022-11-11 21:13:51 +01:00			`- psutil`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- pip:`
Requirements Updates 2022-09-25 19:33:18 +02:00			`- --extra-index-url https://download.pytorch.org/whl/rocm5.1.1`
ROCm torch version pin 2023-01-08 17:10:59 +01:00			`- torch==1.11.*`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- flask-cloudflared`
Migrate to official transformers No longer using VE's fork since its obsolete, in line with what we already did for the CUDA varient. 2021-12-07 23:35:28 +01:00			`- flask-ngrok`
Use eventlet instead of gevent-websocket 2021-12-13 23:19:04 +01:00			`- lupa==1.10`
Typo fix 2022-12-08 15:17:10 +01:00			`- transformers==4.24.0`
Force compatible HF Hub 2022-10-23 18:28:50 +02:00			`- huggingface_hub>=0.10.1`
Add Safetensors Having the dependency adds basic support for safetensor models. 2023-01-06 16:40:56 +01:00			`- safetensors`
Require accelerate Transformers 4.20 now requires accelerate to be installed for some of the features we use in KoboldAI. This is now a required dependency for updated users. 2022-06-16 20:38:58 +02:00			`- accelerate`
Tuner Dependencies 2022-10-22 19:00:06 +02:00			`- git+https://github.com/VE-FORBRYDERNE/mkultra`