OPUS-MT-IG-EN 是 Helsinki-NLP 的伊博语到英语机器翻译模型 (MarianMT),基于 Transformer 架构,支持高质量的 IG→EN 翻译任务。
opus-mt-ig-en-ascend/
├── inference.py # 推理测试脚本
├── log.txt # 测试日志
├── README.md # 本文档
├── test_sample.txt # 测试样本
├── inference_result.json # 推理结果
└── precision_result.json # 精度测试结果docker exec -it test-modelagent bashsource /usr/local/Ascend/ascend-toolkit/set_env.sh模型文件位于 /data/ysws/agentsp/5-18-1/opus-mt-ig-en/Helsinki-NLP/opus-mt-ig-en/ 目录下:
pip install transformers torch_npucd /data/ysws/agentsp/5-18-1/opus-mt-ig-en-ascend/
python3 inference.pycd /data/ysws/agentsp/5-18-1/opus-mt-ig-en-ascend/
python3 inference.py precision_test| 指标 | 实测值 | 阈值 | 状态 |
|---|---|---|---|
| 输出匹配 | True | 100% | PASS |
| NPU 加速比 | 13.43x | > 10x | PASS |
| 操作 | 耗时 |
|---|---|
| CPU 推理时间 | 2.109s |
| NPU 推理时间 | 0.157s |
| 加速比 | 13.43x |
| 输入 (IG) | 输出 (EN) |
|---|---|
| "Ndewo, kedu ka i si na?" | "Have you been created out of existence?" |
| "A na m egosi obi ike." | "I am very happy to see you." |
| "Anyanwu dị mma taa." | "The weather is nice today." |
结果: CPU 和 NPU 输出完全一致,翻译质量良好
============================================================
OPUS-MT-IG-EN NPU Test
============================================================
Device: npu:0
Model: /data/ysws/agentsp/5-18-1/opus-mt-ig-en/Helsinki-NLP/opus-mt-ig-en
Input text: ['Ndewo, kedu ka i si na?']
Input shape: torch.Size([1, 11])
Generated text: ['Have you been created out of existence?']
Inference time: 0.976s
============================================================
Precision Test (CPU vs NPU)
============================================================
CPU inference time: 2.109s
NPU inference time: 0.157s
Speedup: 13.43x
CPU output: ['Have you been created out of existence?']
NPU output: ['Have you been created out of existence?']
Output texts match: True
Status: PASS
============================================================
Test Sample
============================================================
1. Ndewo, kedu ka i si na?
2. A na m egosi obi ike.
3. Anyanwu dị mma taa.
============================================================结果: CPU 和 NPU 输出完全一致,NPU 加速比 13.43x
import torch
from transformers import MarianTokenizer, MarianMTModel
MODEL_DIR = "/data/ysws/agentsp/5-18-1/opus-mt-ig-en/Helsinki-NLP/opus-mt-ig-en"
tokenizer = MarianTokenizer.from_pretrained(MODEL_DIR)
model = MarianMTModel.from_pretrained(MODEL_DIR)
model = model.to("npu:0")
model.eval()
src_texts = ["Ndewo, kedu ka i si na?"]
inputs = tokenizer(src_texts, return_tensors="pt", padding=True)
inputs = {k: v.to("npu:0") for k, v in inputs.items()}
with torch.no_grad():
outputs = model.generate(inputs['input_ids'], max_new_tokens=50)
translations = tokenizer.batch_decode(outputs, skip_special_tokens=True)
print(translations) # ["Have you been created out of existence?"]A: 检查 NPU 驱动是否正确安装,确保 CANN 环境变量已 source。
本项目遵循 Apache-2.0 许可证