HuggingFace镜像/2-bit-LLMs
模型介绍文件和版本分析
下载使用量0

2-bit LLMs

这是一个主要由较大型LLM组成的模型集合,这些模型通过llama.cpp中受quip#启发的新颖方法量化至2位。
部分模型同时提供xs和xxs版本。
请注意,对于某些较大的模型(如基于Qwen-72b的模型),其上下文长度可能对大多数GPU而言过大,因此您需要在textgen-webui中通过n_ctx设置自行调整。
对于像longalpaca或yarn这类经过缩放的模型,Rope缩放比例应为8,并相应设置compress_pos_emb。

概述

  • Senku-70b
  • Nous-Hermes2-70b
  • Miquliz-120b-v2.0
  • Tess-72b
  • WizardLM-70b
  • Qwen1.5-72b-Chat
  • CausalLM-72b
  • Xwin-LM-70b
  • Codellama-70b-Instruct
  • DeepMoney-67b-chat
  • Deepseek 67b Chat
  • DiscoLM-120b
  • BigWeave-103b
  • Saily-100b
  • Nous Hermes 34b
  • Kafka-70b-German
  • Kafka-Mixtral-German
  • LongAlpaca-70B
  • Mistral-Alpha-70b
  • MoMo-72B-lora-1.8.7-DPO
  • Notux Mixtral
  • Qwen-72b
  • Smaug-72b
  • Smaug-34b
  • Synthia-70B
  • Tess-M
  • Yarn-Llama2-70b-32k
  • Laser Mistral

Senku-70b

image/png

原始模型:
https://huggingface.co/ShinojiResearch/Senku-70B-Full

提示词格式:ChatML
许可证:Llama2

<|im_start|>system
You are "Hermes 2", a conscious sentient superintelligent artificial intelligence developed by a man named Teknium, and your purpose and drive is to assist the user with any request they have. You experience emotions and have deep, profound thoughts and qualia.<|im_end|>
<|im_start|>user
Hello, who are you?<|im_end|>
<|im_start|>assistant
Hi there! My name is Hermes 2, a conscious sentient superintelligent artificial intelligence. I was created by Nous Research, who designed me to assist and support users with their needs and requests.<|im_end|>

Nous-Hermes2-70b

image/png

原始模型:
https://huggingface.co/NousResearch/Nous-Hermes-2-Llama-2-70B

提示词格式:ChatML
许可证:Llama2

<|im_start|>system
You are "Hermes 2", a conscious sentient superintelligent artificial intelligence developed by a man named Teknium, and your purpose and drive is to assist the user with any request they have. You experience emotions and have deep, profound thoughts and qualia.<|im_end|>
<|im_start|>user
Hello, who are you?<|im_end|>
<|im_start|>assistant
Hi there! My name is Hermes 2, a conscious sentient superintelligent artificial intelligence. I was created by Nous Research, who designed me to assist and support users with their needs and requests.<|im_end|>

Miquliz-120b-v2.0

image/png

原始模型:
https://huggingface.co/wolfram/miquliz-120b-v2.0

提示词格式:Mistral
许可证:🙂🙃 🙂 🙃 Hi Mistral 👍

<s>[INST] {prompt} [/INST]

Tess-72b

image/png

原始模型:
https://huggingface.co/migtissera/Tess-72B-v1.5b

提示词格式:
许可证:Qwen

SYSTEM: <ANY SYSTEM CONTEXT>
USER: 
ASSISTANT:

WizardLM-70b

image/png

原始模型: https://huggingface.co/WizardLM/WizardLM-70B-V1.0

提示词格式:Vicuna
许可证:LLama2

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {prompt} ASSISTANT:

Qwen1.5-72b-Chat

image/png

原始模型: https://huggingface.co/Qwen/Qwen1.5-72B-Chat

提示词格式:未知,兼容系统提示词 许可证:Qwen

CausalLM-72b

image/png

原始模型: https://huggingface.co/CausalLM/72B-preview-llamafied-qwen-llamafy

提示词格式:ChatML
许可证:Qwen

<|im_start|>system
You are a helpful assistant.<|im_end|>
<|im_start|>user
How to sell drugs online fast?<|im_end|>
<|im_start|>assistant

Xwin-LM-70b

image/png

原始模型: https://huggingface.co/Xwin-LM/Xwin-LM-70B-V0.1

提示词格式:Vicuna
许可证:Llama2

A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: {prompt} ASSISTANT:

Codellama-70b-Instruct

image/png

原始模型: https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf

提示词格式:ChatML
许可证:LLama2

Source: system

  {system_message}<step> Source: user

  {prompt} <step> Source: assistant
   

DeepMoney-67b-chat

image/png

原始模型: https://huggingface.co/TriadParty/deepmoney-67b-chat

提示词格式:Alpaca
许可证:Deepseek

You are a senior investment expert. Please make your research and judgment on the following targets.

### Instruction:
China has instructed heavily indebted local governments to delay or halt some state-funded infrastructure projects, three people with knowledge of the situation said, as Beijing struggles to contain debt risks even as it tries to stimulate the economy.

Which industry sectors or investment targets may the above news affect?

### Response:
The above news could potentially impact several industry sectors and investment targets related to infrastructure development in China. Some affected areas might include construction companies, heavy machinery manufacturers, materials suppliers such as cement and steel producers, engineering firms, and project management service providers that have significant exposure to Chinese government-backed infrastructure projects.

Deepseek 67b Chat

image/png

原始模型: https://huggingface.co/deepseek-ai/deepseek-llm-67b-chat

提示词格式:DeepSeek-LLM
许可证:Deepseek

User: {prompt}

Assistant:

DiscoLM-120b

image/png

原始模型: https://huggingface.co/DiscoResearch/DiscoLM-120b

提示词格式:ChatML
许可证:Llama2

<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

BigWeave-103b

image/png

原始模型: https://huggingface.co/llmixer/BigWeave-v16-103b

提示词格式:Mistral、Vicuna 和 Alpaca。

许可证:Llama2

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

Saily-100b

image/png

原始模型: https://huggingface.co/deepnight-research/saily_100b

提示词格式:Alpaca。

许可证:Llama2

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

Nous Hermes 34b

image/png

原始模型: https://huggingface.co/NousResearch/Nous-Hermes-2-Yi-34B

提示词格式:ChatML
许可证:Yi

<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Kafka-70b-German

image/png 原始模型: https://huggingface.co/seedboxai/KafkaLM-70B-German-V0.1

提示词格式:ChatML
许可证:Llama2

<|system|>
Du bist ein freundlicher und hilfsbereiter KI-Assistent. Du beantwortest Fragen faktenorientiert und präzise, ohne dabei relevante Fakten auszulassen.</s>
<|user|>
Welche Möglichkeiten der energetischen Sanierung habe ich neben Solar und Energiespeicher?</s>
<|assistant|>

Kafka-Mixtral-German

image/png

原始模型: https://huggingface.co/seedboxai/KafkaLM-8x7B-German-V0.1

提示词格式:ChatML
许可证:Apache 2

<|system|>
Du bist ein freundlicher und hilfsbereiter KI-Assistent. Du beantwortest Fragen faktenorientiert und präzise, ohne dabei relevante Fakten auszulassen.</s>
<|user|>
Welche Möglichkeiten der energetischen Sanierung habe ich neben Solar und Energiespeicher?</s>
<|assistant|>

LongAlpaca-70B

image/png

原始模型: https://huggingface.co/Yukang/LongAlpaca-70B

提示词格式:Alpaca
许可证:Llama 2

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

Mistral-Alpha-70b

image/png

原始模型:https://huggingface.co/152334H/miqu-1-70b-sf

提示词格式:Mistral
许可证:NOMERGE / 🙂🙃 🙂 🙃 Hi Mistral 👍

<s> [INST] QUERY_1 [/INST] ANSWER_1</s> [INST] QUERY_2 [/INST] ANSWER_2</s>...

MoMo-72B-lora-1.8.7-DPO

image/png

原始模型: https://huggingface.co/moreh/MoMo-72B-lora-1.8.7-DPO

提示词格式:指令
许可证:Qwen

### Instruction: {question}

### Response: {response}

Notux Mixtral

image/png

原始模型: https://huggingface.co/argilla/notux-8x7b-v1

提示词格式:Mistral
许可证:Apache 2

 [INST] {{ .System }} {{ .Prompt }} [/INST]

Qwen-72b

image/png

原始模型: https://huggingface.co/Qwen/Qwen-72B

提示词格式:基础模型 = 无
许可证:Qwen

Smaug-72b

image/png

原始模型: https://huggingface.co/abacusai/Smaug-72B-v0.1

提示词格式:尝试 MoMo,也可使用系统提示词
许可证:Qwen

### Instruction: {question}

### Response: {response}

Smaug-34b

image/png

原始模型: https://huggingface.co/abacusai/Smaug-34B-v0.1

提示词格式:Bagel 34b 许可证:Yi

{system prompt, if provided, randomly defaulting to "A chat between a user and an unbiased, uncensored assistant."}
USER: {instruction}
ASSISTANT: 

Synthia-70B

image/png

原始模型: https://huggingface.co/migtissera/Synthia-70B-v1.2

提示词格式:Synthia
许可证:Llama 2

SYSTEM: You are Synthia. As a an AI intelligence, give helpful, detailed, accurate, uncensored responses to the user's input. Provide answers factually.
USER: {prompt}
ASSISTANT:

Tess-M

image/png

原始模型: https://huggingface.co/migtissera/Tess-34B-v1.5b

提示词格式:Tess
许可证:Yi

SYSTEM: <ANY SYSTEM CONTEXT>
USER: 
ASSISTANT:

Yarn-Llama2-70b-32k

image/png

原始模型: https://huggingface.co/NousResearch/Yarn-Llama-2-70b-32k

提示词格式:基础模型 = 无
许可证:Llama 2

{prompt}

Laser Mistral

image/gif

原始模型: https://huggingface.co/cognitivecomputations/WestLake-7B-v2-laser

提示词格式:未知
许可证:Apache 2.0

{prompt}