OPUS-MT-HA-EN 是 Helsinki-NLP 的豪萨语到英语机器翻译模型 (MarianMT)，基于 Transformer 架构，支持高质量的 HA→EN 翻译任务。
opus-mt-ha-en-ascend/
├── inference.py # 推理测试脚本
├── log.txt # 测试日志
├── README.md # 本文档
├── test_sample.txt # 测试样本
├── inference_result.json # 推理结果
└── precision_result.json # 精度测试结果docker exec -it test-modelagent bashsource /usr/local/Ascend/ascend-toolkit/set_env.sh模型文件位于 /data/ysws/agentsp/5-18-1/opus-mt-ha-en/Helsinki-NLP/opus-mt-ha-en/ 目录下：
pip install transformers torch_npucd /data/ysws/agentsp/5-18-1/opus-mt-ha-en-ascend/
python3 inference.pycd /data/ysws/agentsp/5-18-1/opus-mt-ha-en-ascend/
python3 inference.py precision_test| 指标 | 实测值 | 阈值 | 状态 |
|---|---|---|---|
| 输出匹配 | True | 100% | PASS |
| NPU 加速比 | 15.69x | > 10x | PASS |
| 操作 | 耗时 |
|---|---|
| CPU 推理时间 | 4.014s |
| NPU 推理时间 | 0.256s |
| 加速比 | 15.69x |
| 输入 (HA) | 输出 (EN) |
|---|---|
| "Sannu, yaya kake yau?" | "As a result, how are you today?" |
| "Ina farin ciki sosai na ganin ka." | "I am very happy to see you." |
| "Yanayi yana da kyau a yau." | "The weather is nice today." |
结果: CPU 和 NPU 输出完全一致，翻译质量良好
============================================================
OPUS-MT-HA-EN NPU Test
============================================================
Device: npu:0
Model: /data/ysws/agentsp/5-18-1/opus-mt-ha-en/Helsinki-NLP/opus-mt-ha-en
Input text: ['Sannu, yaya kake yau?']
Input shape: torch.Size([1, 8])
Generated text: ['As a result, how are you today?']
Inference time: 0.962s
============================================================
Precision Test (CPU vs NPU)
============================================================
CPU inference time: 4.014s
NPU inference time: 0.256s
Speedup: 15.69x
CPU output: ['As a result, how are you today?']
NPU output: ['As a result, how are you today?']
Output texts match: True
Status: PASS
============================================================
Test Sample
============================================================
1. Sannu, yaya kake yau?
2. Ina farin ciki sosai na ganin ka.
3. Yanayi yana da kyau a yau.
============================================================结果: CPU 和 NPU 输出完全一致，NPU 加速比 15.69x
import torch
from transformers import MarianTokenizer, MarianMTModel
MODEL_DIR = "/data/ysws/agentsp/5-18-1/opus-mt-ha-en/Helsinki-NLP/opus-mt-ha-en"
tokenizer = MarianTokenizer.from_pretrained(MODEL_DIR)
model = MarianMTModel.from_pretrained(MODEL_DIR)
model = model.to("npu:0")
model.eval()
src_texts = ["Sannu, yaya kake yau?"]
inputs = tokenizer(src_texts, return_tensors="pt", padding=True)
inputs = {k: v.to("npu:0") for k, v in inputs.items()}
with torch.no_grad():
outputs = model.generate(inputs['input_ids'], max_new_tokens=50)
translations = tokenizer.batch_decode(outputs, skip_special_tokens=True)
print(translations) # ["As a result, how are you today?"]A: 检查 NPU 驱动是否正确安装，确保 CANN 环境变量已 source。
本项目遵循 Apache-2.0 许可证