liucu/multimolecule-borzoi-human-NPU
模型介绍
文件和版本
Pull Requests
讨论
分析

multimolecule/borzoi-human 在 Ascend NPU 上

模型与任务

  • 模型:multimolecule/borzoi-human
  • 版本:6a377a3bf83947284f601ddd57a7ed27b370e4f0
  • 适配路线:long-context-tracks
  • 设备:npu:0

环境依赖

{
  "torch_version": "2.9.0+cpu",
  "torch_npu_available": true,
  "device_name": "Ascend910_9362",
  "device_count": 2,
  "python_version": "3.11.14",
  "dtype": "float32",
  "model_dir": "/opt/atomgit/.cache/huggingface/hub/models--multimolecule--borzoi-human/snapshots/6a377a3bf83947284f601ddd57a7ed27b370e4f0"
}

安装:pip install -r requirements.txt

NPU 推理

默认运行:python inference.py

真实输入

{
  "sequence_length": 524288,
  "target_length": 6144,
  "bin_size": 32,
  "num_labels": 7611,
  "species": "human",
  "alphabet": "A/C/G/T/N",
  "strand": "5'->3'",
  "primary_seq_name": "ACGT_repeat_524k",
  "primary_sha256": "f2dc259afc3d1cf20702c0dd3d12d73419afb56921c944048bde3c7807efe502",
  "primary_sha256_short": "f2dc259afc3d1cf2",
  "primary_seq_prefix": "ACGTACGTACGTACGTACGTACGTACGTACGTACGTACGT",
  "tokenizer": "DnaTokenizer",
  "vocab_size": 5,
  "batch": 1,
  "dtype": "float32",
  "revision": "6a377a3bf83947284f601ddd57a7ed27b370e4f0"
}

真实推理结果

{
  "logits_shape": [
    1,
    6144,
    7611
  ],
  "coverage_shape": [
    1,
    6144,
    7611
  ],
  "logits_dtype": "float32",
  "coverage_dtype": "float32",
  "logits_device": "npu:0",
  "primary_logits_mean": -7.817195892333984,
  "primary_logits_std": 2.97489,
  "primary_coverage_mean": 0.00698101706802845,
  "primary_coverage_max": 0.747097,
  "selected_bins_tracks": {
    "bin0_track0": -10.0192289352417,
    "bin0_track100": -10.543210983276367,
    "bin1000_track0": -10.02025032043457,
    "bin6143_track0": -10.019572257995605
  },
  "batch_shape": [
    3,
    6144,
    7611
  ],
  "batch_names": [
    "ACGT_repeat_524k",
    "TGCA_repeat_524k",
    "poly_A_524k"
  ],
  "batch_means": [
    -7.817253,
    -7.099626,
    -6.485388
  ],
  "num_labels": 7611,
  "problem_type": "regression",
  "output_act": "softplus",
  "finite_proportion": 1.0
}

CPU-NPU 一致性

{
  "passed": true,
  "atol": 0.01,
  "rtol": 0.001,
  "max_abs_diff": 0.007206916809082031,
  "mean_abs_diff": 0.0009201201859513243,
  "shape": [
    1,
    6144,
    7611
  ],
  "elements": 46761984,
  "pearson": 1.0
}

性能

{
  "avg_ms": 235.364114807453,
  "p50_ms": 232.37558302935213,
  "min_ms": 231.897,
  "max_ms": 263.105,
  "windows_per_s": 4.248736052299567,
  "bases_per_s": 2227561.3273880356,
  "input_length": 524288,
  "target_length": 6144,
  "batch_size": 1,
  "dtype": "float32",
  "device": "npu:0",
  "warmup": 3,
  "stable_runs": 10,
  "peak_memory_mb": 9460.0
}

自验证截图

Agent 工作流

NPU 设备调用

模型结果

三张图片均由 xterm.js 根据本次真实日志生成。

已知限制

  • 仅对本次记录的模型 revision、输入契约、dtype 与 Ascend 环境完成验证。

标签

#NPU #Ascend #Ascend910