jsjs1258/optmrl
模型介绍
文件和版本
Pull Requests
讨论
分析

multimolecule/optmrl 适配 Ascend NPU

模型与任务

  • 模型:multimolecule/optmrl
  • 修订版本:e003fc2feced71d6cf11e7336164985e331817e7
  • 适配路线:utr-translation
  • 设备:npu:0

环境依赖

{
  "torch": "2.9.0+cpu",
  "torch_npu": "2.9.0.post1",
  "transformers": "4.57.1",
  "multimolecule": "0.2.4",
  "npu_name": "Ascend910_9362",
  "npu_count": 2,
  "cann": "8.5.1",
  "python": "3.11"
}

安装:pip install -r requirements.txt

NPU 推理

默认执行:python inference.py

真实输入

{
  "primary_sequence": "GGGGCCGGAAGUGCCGCUCCUUGGUGGGGGCUGUUCAUGGCGGUUCCGGGGUCUCCAACAUUUUUCCCGGCUGUGGUCCUAAAUCUGUCCAAAGCAGAGGCAGUGGAGCUUGAGGUUCUUGCUGGUGUGAA",
  "sequence_length": 131,
  "sequence_sha256": "085ce6d59b446cef3eca50f927aa7e992a2c8cbf7b5b9b0818eaa1fa00021fd9",
  "alphabet": "A/C/G/U/N",
  "tokenization": "RnaTokenizer truncation=True max_length=50 padding=max_length replace_T_with_U=true",
  "input_ids_shape": [
    1,
    50
  ],
  "additional_fixtures": [
    "APP_5UTR len=150",
    "insulin_5UTR_like len=141",
    "MYC_5UTR len>200"
  ]
}

真实推理结果

{
  "output_type": "MRL scalar regression (mean ribosome load)",
  "logits_shape": [
    1,
    1
  ],
  "dtype": "float32",
  "device": "npu:0",
  "npu_mrl": -1.9787813425064087,
  "cpu_mrl": -1.9786299467086792,
  "additional_mrl": {
    "APP_5UTR": 0.404829204082489,
    "insulin_5UTR_like": -1.8964329957962036
  }
}

CPU-NPU 一致性

{
  "method": "CPU vs NPU same weights & inputs",
  "sequences_tested": 4,
  "metric": "abs diff MRL",
  "max_abs_diff": 0.0001513957977294922,
  "mean_abs_diff": 8.518248796463013e-05,
  "atol": 0.0001,
  "rtol": 0.0001,
  "passed": true
}

性能

{
  "device": "npu:0",
  "first_compile_ms": 1.99,
  "stable_avg_ms": 1.24,
  "seq_per_s": 805.8,
  "warmup": 3,
  "stable_runs": 10,
  "dtype": "float32",
  "batch": 1,
  "sequence_length": 50,
  "note": "timing with torch.npu.synchronize() before/after; CPU preprocessing excluded"
}

自验证截图

智能体工作流

NPU 设备调用

模型结果

三张图片均由 xterm.js 根据本次真实日志生成。

已知限制

  • 仅对本次记录的模型 revision、输入契约、dtype 与 Ascend 环境完成验证。

标签

#NPU #Ascend #Ascend910