KoboldAI-Client/environments/rocm.yml

name: koboldai
channels:
  - conda-forge
  - defaults
dependencies:
  - colorama
  - flask-socketio
  - flask-session
  - python=3.8.*
  - eventlet
  - markdown
  - bleach=4.1.0
  - pip
  - git=2.35.1
  - sentencepiece
  - protobuf
  - marshmallow>=3.13
  - apispec-webframeworks
  - pip:
    - --find-links https://download.pytorch.org/whl/rocm4.2/torch_stable.html
    - torch==1.10.*
    - torchvision
    - flask-cloudflared
    - flask-ngrok
    - lupa==1.10
    - transformers>=4.20.1
    - accelerate
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`name: koboldai`
			`channels:`
			`- conda-forge`
			`- defaults`
			`dependencies:`
			`- colorama`
			`- flask-socketio`
flask-session for conda 2022-07-04 20:07:11 +02:00			`- flask-session`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- python=3.8.*`
Use eventlet instead of gevent-websocket 2021-12-13 23:19:04 +01:00			`- eventlet`
Welcome Message API Allows model creators to customize the welcome message using Markdown and Limited HTML Existing United users need to run install_requirements..bat again, you can leave the existing dependencies intact. 2022-01-30 19:47:30 +01:00			`- markdown`
Cap Bleach version to 4.1.0 2022-04-12 10:32:27 +02:00			`- bleach=4.1.0`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- pip`
Cap GIT version for now 2022-04-27 18:20:43 +02:00			`- git=2.35.1`
Dependencies required for newer models 2022-02-21 21:17:12 +01:00			`- sentencepiece`
			`- protobuf`
Upload basic API with /generate POST endpoint 2022-08-08 08:27:48 +02:00			`- marshmallow>=3.13`
			`- apispec-webframeworks`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- pip:`
			`- --find-links https://download.pytorch.org/whl/rocm4.2/torch_stable.html`
New Linux Runtime 2022-03-20 00:00:21 +01:00			`- torch==1.10.*`
			`- torchvision`
ROCm Conda Allows anyone to easily create a ROCm compatible conda environment. Currently set to the newer transformers, you can edit the github link if you want the finetune one. 2021-11-17 22:15:01 +01:00			`- flask-cloudflared`
Migrate to official transformers No longer using VE's fork since its obsolete, in line with what we already did for the CUDA varient. 2021-12-07 23:35:28 +01:00			`- flask-ngrok`
Use eventlet instead of gevent-websocket 2021-12-13 23:19:04 +01:00			`- lupa==1.10`
Transformers bump to 4.20.1 Transformers issued an important change for the OPT models breaking their compatibility with all older versions. In order for people to be able to use all models on the menu they need 4.20.1 so this is now forced in the dependencies making the update easier. 2022-06-21 23:33:38 +02:00			`- transformers>=4.20.1`
Require accelerate Transformers 4.20 now requires accelerate to be installed for some of the features we use in KoboldAI. This is now a required dependency for updated users. 2022-06-16 20:38:58 +02:00			`- accelerate`