gcw_6a3w2yXz/basenji
Model Introduction
Files & versions
Pull Requests
Discussion
Analysis

multimolecule/basenji on Ascend NPU

模型与任务

  • 模型:multimolecule/basenji
  • Revision:926c5a3dc8b8a55fea031c644827f0ee5a93b0d5
  • 适配路线:long-context-tracks
  • 设备:npu:0

环境依赖

{
  "torch": "2.9.0+cpu",
  "torch_npu": "2.9.0.post1+gitee7ba04",
  "transformers": "4.57.6",
  "multimolecule": "0.2.1",
  "python": "3.11.14",
  "soc_version": "ascend910_9391",
  "device_name": "Ascend910_9362",
  "npu_count": 2
}

安装:pip install -r requirements.txt

NPU 推理

默认执行:python inference.py

真实输入

{
  "sequence_sha256": "e1e40ef8cc4309bef6ed5de96af40180d44453305407fa6055e064dcd2175463",
  "sequence_length": 131072,
  "sequence_preview_first_60": "ACTCCCCTGCCCTCAACAAGATGTTTTGCCAACTGGCCAAGACCTGCCCTGTGCAGCTGT",
  "alphabet": "ACGT",
  "gc_percent": 62.5,
  "tokenizer": "DnaTokenizer",
  "vocab_size": 5,
  "input_ids_shape": [
    1,
    131072
  ],
  "source": "TP53 example repeated deterministically"
}

真实推理结果

{
  "logits_shape": [
    1,
    896,
    5313
  ],
  "logits_dtype": "float32",
  "logits_device": "npu:0",
  "coverage_shape": [
    1,
    896,
    5313
  ],
  "bin_size": 128,
  "crop_bins": 64,
  "num_tracks": 5313,
  "finite_ratio": 1.0,
  "logits_mean": 1.284869,
  "logits_std": 3.225801,
  "coverage_mean": 1.950899
}

CPU-NPU 一致性

{
  "max_abs_diff": 0.171299,
  "mean_abs_diff": 0.003232,
  "pearson_corr": 0.999998,
  "thresholds": {
    "max_abs": 0.5,
    "mean_abs": 0.02,
    "pearson": 0.99
  },
  "finite_ok": true,
  "shape_ok": true,
  "device_ok": true,
  "status": "PASS"
}

性能

{
  "first_latency_ms": 251.64,
  "stable_avg_ms": 14.36,
  "min_ms": 14.31,
  "max_ms": 14.4,
  "p50_ms": 14.37,
  "p95_ms": 14.4,
  "windows_per_s": 69.63,
  "bases_per_s": 9126320,
  "bins_per_s": 62387,
  "dtype": "float32",
  "batch": 1,
  "n_warmup": 3,
  "n_iter": 10,
  "peak_memory_gb": 0.55
}

自验证截图

Agent workflow

NPU device call

Model result

三张图片均由 xterm.js 根据本次真实日志生成。

已知限制

  • 仅对本次记录的模型 revision、输入契约、dtype 与 Ascend 环境完成验证。

标签

#NPU #Ascend #Ascend910