![]() ![]() CPU Version: Download Airoboros-7B-SuperHOT-GGML from the official HF repository.Download Airoboros-7B-SuperHOT from the official HF repository.For these reasons and more, this portion of the guide will showcase how to download Airoboros-7B-SuperHOT and setup the Simple Proxy to get the most out of the model. Coupled this with proper prompt formatting, and you have a hyper-competent model capable of running on a variety of consumer hardware. Not only does this bring the benefit of making an already competent model better at roleplay, it also extends the context to 8k, far beyond what the AI would be capable of, thanks to Kaiokendev's research into extending context. This version of Airoboros-7B has SuperHOT, a NSFW-focused LoRA, applied to it. Īiroboros-7B is a large language model that has been trained by Jon Durbin using set of synthetic instructions from GPT-4, coding examples, roleplay examples, and examples of multi-character, multi-turn conversations. Place the following prompt in the "Default Author's Note" section:.While still usable, this method will not be getting updated in the event it breaks and may be removed altogether.Īlternatively, you can use the Author's Note / Character Bias extension instead to append the text at the bottom of the chat: This method has been deprecated in favor of methods that are either easier to setup or provide greater customizability/control.
0 Comments
Leave a Reply.AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |