"description":"<strong>Creative model can be used for commercial purposes</strong><br><ul><li>Fast responses<li>Creative responses</li><li>Instruction based</li><li>Trained by Nomic AI<li>Licensed for commercial use</ul>"
},
{
"order":"f",
"md5sum":"11d9f060ca24575a2c303bdc39952486",
@ -72,21 +59,6 @@
"description":"<strong>Very good overall model</strong><br><ul><li>Instruction based<li>Based on the same dataset as Groovy<li>Slower than Groovy, with higher quality responses<li>Trained by Nomic AI<li>Cannot be used commercially</ul>",
"description":"<strong>Best overall smaller model</strong><br><ul><li>Fast responses<li>Chat based<li>Trained by Mosaic ML<li>Cannot be used commercially</ul>",
"systemPrompt":"<|im_start|>system\n- You are a helpful assistant chatbot trained by MosaicML.\n- You answer questions.\n- You are excited to be able to help the user, but will refuse to do anything that could be considered harmful to the user.\n- You are more than just an information source, you are also able to write poetry, short stories, and make jokes.<|im_end|>"
"systemPrompt":"### System:\nYou are an AI assistant that follows instruction extremely well. Help as much as you can.\n\n"
},
{
"order":"k",
"md5sum":"29119f8fa11712704c6b22ac5ab792ea",
"name":"Vicuna",
"filename":"ggml-vicuna-7b-1.1-q4_2.bin",
"filesize":"4212859520",
"ramrequired":"8",
"parameters":"7 billion",
"quant":"q4_2",
"type":"LLaMA",
"systemPrompt":" ",
"description":"<strong>Good small model - trained by teams from UC Berkeley, CMU, Stanford, MBZUAI, and UC San Diego</strong><br><ul><li>Instruction based<li>Cannot be used commercially</ul>"
},
{
"order":"l",
"md5sum":"95999b7b0699e2070af63bf5d34101a8",
"name":"Vicuna (large)",
"filename":"ggml-vicuna-13b-1.1-q4_2.bin",
"filesize":"8136770688",
"ramrequired":"16",
"parameters":"13 billion",
"quant":"q4_2",
"type":"LLaMA",
"systemPrompt":" ",
"description":"<strong>Good larger model - trained by teams from UC Berkeley, CMU, Stanford, MBZUAI, and UC San Diego</strong><br><ul><li>Instruction based<li>Cannot be used commercially</ul>"
},
{
"order":"m",
"md5sum":"99e6d129745a3f1fb1121abed747b05a",
"name":"Wizard",
"filename":"ggml-wizardLM-7B.q4_2.bin",
"filesize":"4212864640",
"ramrequired":"8",
"parameters":"7 billion",
"quant":"q4_2",
"type":"LLaMA",
"systemPrompt":" ",
"description":"<strong>Good small model - trained by by Microsoft and Peking University</strong><br><ul><li>Instruction based<li>Cannot be used commercially</ul>"
},
{
"order":"n",
"md5sum":"6cb4ee297537c9133bddab9692879de0",
"name":"Stable Vicuna",
"filename":"ggml-stable-vicuna-13B.q4_2.bin",
"filesize":"8136777088",
"ramrequired":"16",
"parameters":"13 billion",
"quant":"q4_2",
"type":"LLaMA",
"description":"<strong>Trained with RLHF by Stability AI</strong><br><ul><li>Instruction based<li>Cannot be used commercially</ul>",
"systemPrompt":"## Assistant: I am StableVicuna, a large language model created by CarperAI. I am here to chat!\n\n"
},
{
"order":"o",
"md5sum":"1cfa4958f489f0a0d1ffdf6b37322809",
"name":"MPT Instruct",
"filename":"ggml-mpt-7b-instruct.bin",
"filesize":"4854401028",
"requires":"2.4.1",
"ramrequired":"8",
"parameters":"7 billion",
"quant":"q4_0",
"type":"MPT",
"systemPrompt":" ",
"description":"<strong>Mosaic's instruction model</strong><br><ul><li>Instruction based<li>Trained by Mosaic ML<li>Licensed for commercial use</ul>"
},
{
"order":"p",
"md5sum":"120c32a51d020066288df045ef5d52b9",
"name":"MPT Base",
"filename":"ggml-mpt-7b-base.bin",
"filesize":"4854401028",
"requires":"2.4.1",
"ramrequired":"8",
"parameters":"7 billion",
"quant":"q4_0",
"type":"MPT",
"systemPrompt":" ",
"description":"<strong>Trained for text completion with no assistant finetuning</strong><br><ul><li>Completion based<li>Trained by Mosaic ML<li>Licensed for commercial use</ul>"
},
{
"order":"q",
"md5sum":"d5eafd5b0bd0d615cfd5fd763f642dfe",
"name":"Nous Vicuna",
"filename":"ggml-nous-gpt4-vicuna-13b.bin",
"filesize":"8136777088",
"ramrequired":"16",
"parameters":"13 billion",
"quant":"q4_0",
"type":"LLaMA",
"systemPrompt":" ",
"description":"<strong>Trained on ~180,000 instructions</strong><br><ul><li>Instruction based<li>Trained by Nous Research<li>Cannot be used commercially</ul>"
Adam Treat
11 months ago