Finetune version of rocm

Seperate file so people can easily go back to the legacy implementation based on finetune (Recommended until Huggingface's compatibility is improved) . You can install and use both.

environments/rocm-finetune.yml

@@ -0,0 +1,16 @@
+name: koboldai-ft
+channels:
+  - conda-forge
+  - defaults
+dependencies:
+  - colorama
+  - flask-socketio
+  - python=3.8.*
+  - pip
+  - git
+  - pip:
+    - --find-links https://download.pytorch.org/whl/rocm4.2/torch_stable.html
+    - torch
+    - torchvision==0.11.1
+    - flask-cloudflared
+    - git+https://github.com/finetuneanon/transformers@gpt-neo-localattention3-rp-b