HuggingFace镜像/Lumina-3.5
模型介绍文件和版本分析
下载使用量0

Lumina-3.5

Lumina-3.5 是一款基于 LazyMergekit 构建的混合专家模型(Mixture of Experts, MoE),它在 Lumina-3 的基础上提升了推理能力。该模型支持的上下文窗口长度最高可达 32k。

响应示例

Input: 25 - 4 * 2 + 3 = ?
------------------------------------
Output: To solve this equation, we will follow the order of operations (PEMDAS/BODMAS). This means performing any multiplications and divisions first from left to right, and then additions and subtractions from left to right.

The given equation is: 25 - 4 * 2 + 3

First, let's perform the multiplication:
4 * 2 = 8

Now, our equation looks like: 25 - 8 + 3

Next, perform the subtraction:
25 - 8 = 17

Finally, do the addition:
17 + 3 = 20

So, the result of the equation 25 - 4 * 2 + 3 is 20.
Input: Jane is faster than Joe. Joe is faster than Sam. Is Sam faster than Jane? Explain your reasoning step by step.
------------------------------------
Output: To answer this question, let's analyze the given information step by step:

We are provided with a comparison between three individuals - Jane, Joe, and Sam - in terms of their relative speeds. The statements tell us the following about their ranks:
Jane > Joe (Jane is faster than Joe)
Joe > Sam (Joe is faster than Sam)
Now we need to determine if the opposite relationship holds true: whether Sam is faster than Jane or not. Based on the given comparisons, we know that both Jane and Joe have faster speeds compared to Sam. There isn't any piece of information suggesting otherwise.

Since the original premise established an ordered ranking among these individuals (Jane > Joe > Sam), and the direct opposite of the relationship between Sam and the other two is not present, we cannot conclude that Sam is faster than Jane.

Thus, based on the provided information, our reasoning confirms that Sam is not faster than Jane.

🏆 Open LLM 排行榜评估结果

指标数值
平均值75.41
AI2 推理挑战(25次射击)71.59
HellaSwag(10次射击)88.82
MMLU(5次射击)64.48
TruthfulQA(0次射击)75.66
Winogrande(5次射击)83.98
GSM8k(5次射击)67.93

量化版本

特别感谢 mradermacher 制作的 GGUF 文件

  • mradermacher/Lumina-3.5-GGUF

💻 使用方法

!pip install -qU transformers bitsandbytes accelerate

from transformers import AutoTokenizer
import transformers
import torch

model = "Ppoyaa/Lumina-3.5"

tokenizer = AutoTokenizer.from_pretrained(model)
pipeline = transformers.pipeline(
    "text-generation",
    model=model,
    model_kwargs={"torch_dtype": torch.float16, "load_in_4bit": True},
)

messages = [{"role": "user", "content": "Explain what a Mixture of Experts is in less than 100 words."}]
prompt = pipeline.tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])

Open LLM 排行榜评估结果

详细结果可查看此处

指标数值
平均值75.41
AI2 推理挑战赛(25次射击)71.59
HellaSwag(10次射击)88.82
MMLU(5次射击)64.48
TruthfulQA(0次射击)75.66
Winogrande(5次射击)83.98
GSM8k(5次射击)67.93