Qwen2-14B-merge 是 Qwen/Qwen2-7B-Instruct 的合并模型。
🧩 配置
```yaml
dtype: float16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 6]
model: Qwen/Qwen2-7B-Instruct
- sources:
- layer_range: [3, 9]
model: Qwen/Qwen2-7B-Instruct
- sources:
- layer_range: [6, 12]
model: Qwen/Qwen2-7B-Instruct
- sources:
- layer_range: [9, 15]
model: Qwen/Qwen2-7B-Instruct
- sources:
- layer_range: [12, 18]
model: Qwen/Qwen2-7B-Instruct
- sources:
- layer_range: [15, 21]
model: Qwen/Qwen2-7B-Instruct
- sources:
- layer_range: [18, 24]
model: Qwen/Qwen2-7B-Instruct
- sources:
- layer_range: [21, 28]
model: Qwen/Qwen2-7B-Instruct
```