waylong/mtsplice
Model Introduction
Files & versions
Pull Requests
Discussion
Analysis

multimolecule/mtsplice on Ascend NPU

模型与任务

  • 模型:multimolecule/mtsplice
  • Revision:a3826976df62ae133f72d72a8c13d9b18777841b
  • 适配路线:splicing
  • 设备:npu:0

环境依赖

{
  "torch": "2.9.0+cpu",
  "torch_npu": "2.9.0.post1+gitee7ba04",
  "device_name": "Ascend910_9362",
  "device_count": 2
}

安装:pip install -r requirements.txt

NPU 推理

默认执行:python inference.py

真实输入

{
  "reference_length": 800,
  "alternative_length": 800,
  "reference_sha256": "f6f0d0cbf12272607992c06a95baec6e3efb5eb6f1b4ccc9e22a215a6a6a3c2c",
  "alternative_sha256": "770d39cd241c8e11917ff99ddf545b6821bbf67d5dbdb7174aa6fb347b03b351",
  "variant": "pos400 U->G",
  "acceptor_length": 400,
  "donor_length": 400,
  "alphabet": "A/C/G/U/N, replace_T_with_U true",
  "direction": "5'->3'",
  "vocab": {
    "A": 0,
    "C": 1,
    "G": 2,
    "U": 3,
    "N": 4
  }
}

真实推理结果

{
  "logits_shape": [
    1,
    56
  ],
  "logits_dtype": "torch.float32",
  "logits_device": "npu:0",
  "logits_sample": [
    0.7847409844398499,
    -0.10304500162601471,
    0.13834697008132935,
    -0.041529878973960876,
    -0.37342819571495056
  ],
  "delta_sample": [
    -0.0034401416778564453,
    0.0005097314715385437,
    0.0004758685827255249,
    0.0007765740156173706,
    0.0012853443622589111
  ],
  "logits_mean": 0.11003809422254562,
  "logits_std": 0.606224536895752
}

CPU-NPU 一致性

{
  "max_abs_diff_logits": 0.00014972686767578125,
  "mean_abs_diff_logits": 5.2083767513977364e-05,
  "max_abs_diff_delta": 1.5735626220703125e-05,
  "mean_abs_diff_delta": 1.1231085181862e-06,
  "atol": 0.001,
  "rtol": 0.001,
  "passed": true
}

性能

{
  "first_iter_s": 0.005345344543457031,
  "stable_avg_ms": 4.647040367126465,
  "seq_per_s": 215.19072807589106,
  "bases_per_s": 172152.58246071285,
  "stable_iters": 10,
  "warmup_iters": 3,
  "input_length": 800,
  "batch": 1,
  "dtype": "torch.float32"
}

自验证截图

Agent workflow

NPU device call

Model result

三张图片均由 xterm.js 根据本次真实日志生成。

已知限制

  • 仅对本次记录的模型 revision、输入契约、dtype 与 Ascend 环境完成验证。

标签

#NPU #Ascend #Ascend910