diff --git a/colab/TPU.ipynb b/colab/TPU.ipynb index 29973043..1558e666 100644 --- a/colab/TPU.ipynb +++ b/colab/TPU.ipynb @@ -14,195 +14,21 @@ "cell_type": "markdown", "source": [ "# Welcome to KoboldAI on Google Colab, TPU Edition!\n", - "KoboldAI is a powerful and easy way to use a variety of AI based text generation experiences. You can use it to write stories, blog posts, play a text adventure game, use it like a chatbot and more! In some cases it might even help you with an assignment or programming task (But always make sure the information the AI mentions is correct, it loves to make stuff up).\n", + "KoboldAI used to have a very powerful TPU engine for the TPU colab allowing you to run models above 6B, we have since moved on to more viable GPU based solutions that work across all vendors rather than splitting our time maintaing a colab exclusive backend.\n", "\n", - "For more information about KoboldAI check our our Github readme : https://github.com/KoboldAI/KoboldAI-Client/blob/main/readme.md\n", + "If you were brought here by a (video) tutorial keep in mind the tutorial you are following is very out of date.\n", "\n", - "More (smaller) models are available in the **[GPU edition](https://colab.research.google.com/github/koboldai/KoboldAI-Client/blob/main/colab/GPU.ipynb)**!\n", + "We recommend that you switch to Koboldcpp, our most modern solution that runs fantastic on Google Colab's GPU's allowing a similar level of performance that you were using before on the TPU at a fraction of the loading times.\n", "\n", - "---\n", - "## How to load KoboldAI: Everything you need to know\n", - "1. On a phone? First put your browser in desktop mode because of a Google Colab bug. Otherwise nothing will happen when you click the play button. Then tap the play button next to \"<-- Tap This if you play on Mobile\", you will see an audio player. Keep the audio player playing so Colab does not get shut down in the background.\n", - "2. Select the desired model, you will find a description of all the available models further down the page.\n", - "3. Click the play button next to \"<-- Select your model below and then click this to start KoboldAI\".\n", - "4. Got a message saying no accelerator is available? Click cancel, and try again in a few minutes. If you do not manage to get a session when you frequently try again try at a different time of day, colab can be busy or your priority may have been lowered by frequent usage.\n", - "5. After everything is done loading you will get a link that you can use to open KoboldAI. In case of Localtunnel you will also be warned that some people are abusing Localtunnel for phishing, once you acknowledge this warning you will be taken to KoboldAI's interface. If you picked Cloudflare and get a 1033 error refresh the error page after waiting one minute.\n", + "# [Click here to go to the KoboldCpp Colab](https://koboldai.org/colabcpp)\n", "\n", - "---\n", + "The model you wish to use not available in GGUF format? You can use our [GPU colab](https://koboldai.org/colab) and select the United version to load models up to 13B.\n", "\n", - "Further down the page you can find descriptions of the models, and tips to get the most out of your Google Colab experience.\n", - "\n", - "Make sure to keep this page open while you are using KoboldAI, and check back regularly to see if you got a Captcha. Failure to complete the captcha's in time can result in termination of your session or a lower priority towards the TPUs.\n", - "\n", - "Firefox users need to disable the enhanced tracking protection or use a different browser in order to be able to use Google Colab without errors (This is not something we can do anything about, the cookie blocker breaks the Google Drive integration because it uses different domains)." + "Both versions are capable of using our API and will work as you expect from a KoboldAI product. If you are following a tutorial the rest of the instructions may apply to these newer versions of our products." ], "metadata": { "id": "zrLGxVCEaqZx" } - }, - { - "cell_type": "code", - "source": [ - "#@title <-- Tap this if you play on Mobile { display-mode: \"form\" }\n", - "%%html\n", - "Press play on the music player to keep the tab alive, then start KoboldAI below (Uses only 13MB of data)
\n", - "