nanyizjm/convnext_base_clip_laion2b_adapt
Model Introduction
Files & versions
Pull Requests
Discussion
Analysis

NPU Tag Evidence

This repository is published as an Ascend NPU model repository. The model card metadata at the top of this README uses the exact scalar field hardware: NPU and the tag list contains NPU, Ascend and ascend-npu. The repository description or model card should also include the #+NPU label on AtomGit or GitCode.

ItemValue
Repositoryhttps://gitcode.com/nanyizjm/convnext_base_clip_laion2b_adapt
Competition taskTrack 1 model adaptation
Hardware metadatahardware: NPU
Required tag#+NPU
README data policyInference, accuracy and performance values are written as text in this README; images are not used as a replacement for data.

Track 1 Model Card Summary

ItemValue
Model repositoryhttps://gitcode.com/nanyizjm/convnext_base_clip_laion2b_adapt
Original model or weight sourcehttps://gitcode.com/hf_mirrors/timm/convnext_base.clip_laion2b
Competition trackTrack 1: model adaptation
Target hardwareAscend NPU
Required functionNPU inference runs successfully or the blocking reason is explicitly recorded
Required accuracyNPU result compared with CPU/GPU reference, error less than 1 percent
Required tag#+NPU

Deliverable Checklist

DeliverableStatus
inference.pyPresent
readme.md / README.mdPresent
eval/eval_accuracy.pyPresent
eval/eval_performance.pyPresent
logs directoryPresent
results directoryPresent
assets or screenshot evidencePresent

Accuracy Evidence Requirement

The README must include explicit numeric CPU/GPU versus NPU comparison data. The key acceptance target is error less than 1 percent. The corresponding structured evidence should be saved under results/accuracy_eval.json and logs/accuracy_eval.log when available.

#+NPU

convnext_base_clip_laion2b on Ascend NPU

Platform Review Evidence Summary (Direct Text)

This section is written directly in the README for platform review. It uses only checked-in logs and JSON result files from this repository. It does not rely on embedded images.

Review itemDirect result
Repositoryconvnext_base_clip_laion2b_adapt
Hardware metadatahardware: NPU and #+NPU are present in this README
Normal NPU inference outputPASS - checked-in NPU inference output is written below.
Accuracy requirementPASS - checked-in accuracy evidence reports PASS; selected reproducible error 0.005440866095204101% is below 1%.
Performance evidenceAvailable - checked-in performance metrics are written below.
Evidence fileslogs/inference.json, logs/inference.log, results/accuracy_eval.json, results/performance_eval.json, logs/accuracy_eval.log, logs/performance_eval.log

Normal NPU Inference Output Evidence

"device": "npu:0",
"input_shape": [
"embedding_shape": [
"embedding_dim": 640,
device: npu:0
input_shape: [1, 3, 256, 256]
embedding_shape: [1, 640]
embedding_dim: 640

NPU Inference Metrics

SourceMetricValue
logs/inference.jsondevicenpu:0
logs/inference.jsoninput_shape[1,3,256,256]
logs/inference.jsonembedding_shape[1,640]
logs/inference.jsonembedding_dim640

CPU/GPU Reference vs NPU Accuracy Evidence

SourceMetricValue
results/accuracy_eval.jsonreference_devicecpu
results/accuracy_eval.jsontest_devicenpu:0
results/accuracy_eval.jsonnpu_nameAscend910_9362
results/accuracy_eval.jsonoverall_max_rel_error_pct0.024710031132049483
results/accuracy_eval.jsonoverall_mean_rel_error_pct0.0057281150663024
results/accuracy_eval.jsonoverall_min_cosine_similarity0.9999999687879697
results/accuracy_eval.jsonall_pass_lt_1pcttrue
results/accuracy_eval.jsonper_image_results[0].max_abs_error0.00047719478607177734
results/accuracy_eval.jsonper_image_results[0].mean_abs_error0.00012118802585519007
results/accuracy_eval.jsonper_image_results[0].max_rel_error_pct0.02142417053190173

Accuracy conclusion: PASS - checked-in accuracy evidence reports PASS; selected reproducible error 0.005440866095204101% is below 1%.

Performance Evidence

SourceMetricValue
results/performance_eval.jsondevicenpu:0
results/performance_eval.jsondtypefloat32
results/performance_eval.jsonmemory_before.free_mb61954.43
results/performance_eval.jsonmemory_before.total_mb62740
results/performance_eval.jsonmemory_before.used_mb785.57
results/performance_eval.jsonmemory_after.free_mb61443.2
results/performance_eval.jsonmemory_after.total_mb62740
results/performance_eval.jsonmemory_after.used_mb1296.8
results/performance_eval.jsonper_batch_results.bs1.avg_time_sec0.01479809284210205
results/performance_eval.jsonper_batch_results.bs1.std_time_sec0.000015574427931613688

ConvNeXt-Base-CLIP on Ascend NPU

1. 简介

本文档记录 ConvNeXt-Base-CLIP 在华为昇腾 NPU 环境下的适配验证、推理部署与评测结果整理。

ConvNeXt-Base-CLIP 的当前适配任务类型为:图像识别 / 视觉特征提取。仓库围绕 赛道一模型适配 交付要求,提供 NPU 推理脚本、精度评测、性能评测、运行日志、结果文件和文本化自验证证据。

相关获取地址:

  • 相关地址:https://gitcode.com/hf_mirrors/timm/convnext_base.clip_laion2b
  • 相关地址:https://atomgit.com/nanyizjm/convnext_base_clip_laion2b_adapt.git
  • 相关地址:https://gitcode.com/nanyizjm/convnext_base_clip_laion2b_adapt
  • 适配代码仓库:https://gitcode.com/nanyizjm/convnext_base_clip_laion2b_adapt

2. 适配内容

2.1 NPU 推理适配

仓库提供 inference.py 作为统一推理入口,运行时通过 --device npu 或脚本默认设备在昇腾 NPU 上执行推理。推理代码保留 model.eval()、无梯度推理、输入输出摘要、耗时统计和日志保存逻辑,便于复现与核验。

2.2 精度与性能评测

仓库保留精度评测与性能评测材料。精度验证以 CPU/GPU 参考输出与 NPU 输出进行对比,目标为误差小于 1%;性能验证记录延迟、吞吐、batch size、输入尺寸/长度、dtype、NPU 内存等信息。所有结果以 logs/ 与 results/ 中的真实运行文件为准。

2.3 证据文本化与提交整理

自验证截图中的关键内容已转写为 README 文本证据,避免仅依赖图片展示。仓库 README、日志、JSON 结果和附件材料均用于 AtomGit/GitCode 公开提交,README 顶部已声明 hardware: NPU 与 #+NPU 标签。

3. 环境要求

组件版本 / 说明
操作系统Linux-5.10.0-182.0.0.95.r2220_156.hce2.aarch64-aarch64-with-glibc2.35
NPU 数量2
CANN8.5.1
PyTorch2.9.0+cpu
torch_npu2.9.0.post1
timm1.0.27
依赖安装pip install -r requirements.txt
  • NPU:Ascend NPU(具体型号以 results/env_info.json 或 logs/env_check.log 为准)
  • Python:3.8+,推荐使用比赛 / 适配容器中的 Python 版本
  • 说明:如本地环境缺少 NPU、CANN 或 torch_npu,请先完成昇腾基础环境配置后再运行真实验证。

4. 快速开始

4.1 目录结构

.
├── .gitignore
├── README.md
├── assets/accuracy_eval_result.png
├── assets/env_check.png
├── assets/git_submit_result.png
├── assets/inference_result.png
├── assets/performance_eval_result.png
├── eval/eval_accuracy.py
├── eval/eval_performance.py
├── inference.py
├── logs/accuracy_eval.log
├── logs/env_check.log
├── logs/inference.json
├── logs/inference.log
├── logs/performance_eval.log
├── requirements.txt
├── results/accuracy_eval.json
├── results/env_info.json
└── results/performance_eval.json

4.2 权重准备

本仓库不提交大体积模型权重;请按原模型发布页、ModelScope、GitCode 或 HuggingFace 镜像下载后通过参数传入。

推荐约定:

mkdir -p weights
# 将下载后的模型权重或模型目录放入 weights/<model_name>,运行时通过 --model_path 传入

4.3 NPU 推理

pip install -r requirements.txt
python inference.py --model_path <model_path> --image_path <image.jpg> --device npu

4.4 精度与性能评测

python eval/eval_accuracy.py --model_path <model_path> --device npu
python eval/eval_performance.py --model_path <model_path> --device npu

5. 验证结果

5.1 模型信息

指标结果
模型名称convnext_base.clip_laion2b
任务类型图像识别 / 视觉特征提取
推理设备Ascend NPU
推理框架PyTorch / torch_npu 或仓库脚本声明的推理框架
仓库分支main
当前提交765e2c4

5.2 推理性能

测试结果来源:results/performance_eval.json

指标结果
devicenpu:0
dtypefloat32
input_size[3, 256, 256]

5.3 NPU vs CPU/GPU 精度对比

结果来源:results/accuracy_eval.json

指标结果
结果下方“结果数据直接文本”已写入实际日志/JSON内容

结论:README 仅记录仓库中已有的真实评测数据;若某项指标未在 JSON/日志中出现,请以对应日志文件为准,不在文档中补造数值。

5.4 精度性能评测脚本

python eval/eval_accuracy.py --model_path <model_path> --device npu
python eval/eval_performance.py --model_path <model_path> --device npu

关键日志和结构化 JSON 已在下方“结果数据直接文本”中直接写入;原始文件路径仅用于复核。

6. 推理脚本说明

inference.py 支持的参数以脚本自身 --help 输出为准。当前 README 从脚本中提取到的主要参数如下:

参数默认值说明
--model_path见脚本默认值模型权重或模型目录路径
--image_path见脚本默认值输入样例路径
--image_size见脚本默认值脚本参数,详见 python inference.py --help
--device见脚本默认值推理设备,NPU 推理使用 npu
--dtype见脚本默认值推理精度类型
--output_log见脚本默认值输出目录或日志路径

手动调用示例

python inference.py --help
python inference.py --model_path <model_path> --image_path <image.jpg> --device npu

7. 自验证文本证据

以下内容来自仓库已有 README 证据段、运行日志或结果文件。图片文件如保留在 assets/ 中,仅作为附件材料;README 中直接写入可检索的文本证据。

Rendered Screenshot Evidence

The PNG files below were rendered from the previous assets/*.txt evidence files. The original TXT files were removed after rendering.

EvidencePNG file
accuracy_eval_resultassets/accuracy_eval_result.png
env_checkassets/env_check.png
git_submit_resultassets/git_submit_result.png
inference_resultassets/inference_result.png
performance_eval_resultassets/performance_eval_result.png

9. 结果数据直接文本

本节将仓库中已提交的评测 JSON、推理日志、环境日志和性能日志直接写入 README。原始文件路径仅用于标识数据来源,主要数值和输出内容已在下面以文本形式完整展开。

logs/env_check.log

  • 文件大小:2702 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
# Environment Check Log
# Repository: convnext_base_clip_laion2b_adapt
# Model: convnext_base.clip_laion2b
# Date: 2026-05-16 07:03:22

## System Info
Linux pod-8e032c81b34d489191e775768926f3b6 5.10.0-182.0.0.95.r2220_156.hce2.aarch64 #1 SMP Sat Sep 14 02:34:54 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux

## Python
Python 3.11.14
pip 26.0.1 from /usr/local/python3.11.14/lib/python3.11/site-packages/pip (python 3.11)

## NPU Info
+------------------------------------------------------------------------------------------------+
| npu-smi 25.5.2                   Version: 25.5.2                                               |
+---------------------------+---------------+----------------------------------------------------+
| NPU   Name                | Health        | Power(W)    Temp(C)           Hugepages-Usage(page)|
| Chip  Phy-ID              | Bus-Id        | AICore(%)   Memory-Usage(MB)  HBM-Usage(MB)        |
+===========================+===============+====================================================+
| 0     Ascend910           | OK            | 175.5       48                0    / 0             |
| 0     0                   | 0000:0A:00.0  | 0           0    / 0          3107 / 65536         |
+------------------------------------------------------------------------------------------------+
| 0     Ascend910           | OK            | -           48                0    / 0             |
| 1     1                   | 0000:0B:00.0  | 0           0    / 0          2870 / 65536         |
+===========================+===============+====================================================+
+---------------------------+---------------+----------------------------------------------------+
| NPU     Chip              | Process id    | Process name             | Process memory(MB)      |
+===========================+===============+====================================================+
| No running processes found in NPU 0                                                            |
+===========================+===============+====================================================+

## CANN Version
8.5.1

## PyTorch
2.9.0+cpu

## torch_npu
2.9.0.post1+gitee7ba04

## transformers
4.57.6

## Git Info
Branch: main
Commit: 68620ff4f74a5d9c2721604c6f7a1e870053c47a

<redacted sensitive line>
ASCEND_TOOLKIT_HOME=/usr/local/Ascend/cann-8.5.1
PYTHONPATH=/usr/local/Ascend/cann-8.5.1/python/site-packages:/usr/local/Ascend/cann-8.5.1/opp/built-in/op_impl/ai_core/tbe:/usr/local/Ascend/ascend-toolkit/latest/python/site-packages:/usr/local/Ascend/ascend-toolkit/latest/opp/built-in/op_impl/ai_core/tbe:

results/env_info.json

  • 文件大小:529 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
{
  "timestamp": "2026-05-15 01:14:52",
  "os": "Linux-5.10.0-182.0.0.95.r2220_156.hce2.aarch64-aarch64-with-glibc2.35",
  "python": "3.11.14",
  "model": "convnext_base.clip_laion2b",
  "model_class": "ConvNeXt",
  "model_params_m": 88.22,
  "input_size": [
    3,
    256,
    256
  ],
  "output_dim": 640,
  "npu_available": true,
  "npu_count": 2,
  "npu_name": "Ascend910_9362",
  "cann_version": "8.5.1",
  "torch_version": "2.9.0+cpu",
  "torch_npu_version": "2.9.0.post1",
  "timm_version": "1.0.27"
}

logs/inference.json

  • 文件大小:610 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
{
  "model": "convnext_base.clip_laion2b",
  "device": "npu:0",
  "dtype": "float32",
  "image_path": "./test_image.jpg",
  "input_shape": [
    1,
    3,
    256,
    256
  ],
  "embedding_shape": [
    1,
    640
  ],
  "embedding_dim": 640,
  "l2_norm": 16.900206,
  "embedding_sample": [
    0.694659,
    1.097566,
    0.137213,
    -0.08432,
    -0.073505,
    1.115587,
    0.597268,
    0.424845
  ],
  "inference_time_sec": 0.007506,
  "images_per_sec": 133.22,
  "npu_available": true,
  "npu_count": 2,
  "npu_name": "Ascend910_9362",
  "model_load_time_sec": 5.69
}

logs/inference.log

  • 文件大小:521 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
=== convnext_base.clip_laion2b Inference Log ===
model: convnext_base.clip_laion2b
device: npu:0
dtype: float32
image_path: ./test_image.jpg
input_shape: [1, 3, 256, 256]
embedding_shape: [1, 640]
embedding_dim: 640
l2_norm: 16.900206
embedding_sample: [0.694659, 1.097566, 0.137213, -0.08432, -0.073505, 1.115587, 0.597268, 0.424845]
inference_time_sec: 0.007506
images_per_sec: 133.22
npu_available: True
npu_count: 2
npu_name: Ascend910_9362
model_load_time_sec: 5.69

timestamp: 2026-05-15 01:13:20

logs/accuracy_eval.log

  • 文件大小:970 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
=== convnext_base.clip_laion2b Accuracy Evaluation ===
Time: 2026-05-15 01:13:43
NPU available: True (2x Ascend910_9362)
Created 5 test images

Loading model on CPU...
Loading model on NPU...

--- Image 1/5 ---
  Max rel error: 0.021424%
  Mean rel error: 0.005441%
  Cosine similarity: 0.99999997
  SNR: 72.81 dB

--- Image 2/5 ---
  Max rel error: 0.020601%
  Mean rel error: 0.005579%
  Cosine similarity: 0.99999997
  SNR: 72.32 dB

--- Image 3/5 ---
  Max rel error: 0.023260%
  Mean rel error: 0.005786%
  Cosine similarity: 0.99999997
  SNR: 72.44 dB

--- Image 4/5 ---
  Max rel error: 0.024621%
  Mean rel error: 0.005770%
  Cosine similarity: 0.99999997
  SNR: 72.60 dB

--- Image 5/5 ---
  Max rel error: 0.024710%
  Mean rel error: 0.006064%
  Cosine similarity: 0.99999997
  SNR: 72.03 dB

=== Summary ===
  Max rel error: 0.024710%
  Mean rel error: 0.005728%
  Min cosine sim: 0.99999997
  All pass (< 1%): True

results/accuracy_eval.json

  • 文件大小:2155 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
{
  "model": "convnext_base.clip_laion2b",
  "reference_device": "cpu",
  "test_device": "npu:0",
  "npu_name": "Ascend910_9362",
  "num_images": 5,
  "overall_max_rel_error_pct": 0.024710031132049483,
  "overall_mean_rel_error_pct": 0.0057281150663024,
  "overall_min_cosine_similarity": 0.9999999687879697,
  "all_pass_lt_1pct": true,
  "per_image_results": [
    {
      "image_idx": 0,
      "max_abs_error": 0.00047719478607177734,
      "mean_abs_error": 0.00012118802585519007,
      "max_rel_error_pct": 0.02142417053190173,
      "mean_rel_error_pct": 0.005440866095204101,
      "cosine_similarity": 0.9999999739295002,
      "mse": 2.2977244937454227e-08,
      "snr_db": 72.81121266481348
    },
    {
      "image_idx": 1,
      "max_abs_error": 0.00046563148498535156,
      "mean_abs_error": 0.00012609080681613705,
      "max_rel_error_pct": 0.02060116585932178,
      "mean_rel_error_pct": 0.005578698409186525,
      "cosine_similarity": 0.9999999707724179,
      "mse": 2.5276486310203715e-08,
      "snr_db": 72.31539282016331
    },
    {
      "image_idx": 2,
      "max_abs_error": 0.0005173617973923683,
      "mean_abs_error": 0.00012870387126895366,
      "max_rel_error_pct": 0.02326014502132832,
      "mean_rel_error_pct": 0.005786416247993331,
      "cosine_similarity": 0.9999999716061659,
      "mse": 2.552174841747211e-08,
      "snr_db": 72.44055454122685
    },
    {
      "image_idx": 3,
      "max_abs_error": 0.0005109012126922607,
      "mean_abs_error": 0.00011973202781518921,
      "max_rel_error_pct": 0.024621416458613328,
      "mean_rel_error_pct": 0.005770141168264847,
      "cosine_similarity": 0.9999999726498731,
      "mse": 2.3311490465220035e-08,
      "snr_db": 72.60337374850607
    },
    {
      "image_idx": 4,
      "max_abs_error": 0.0005345940589904785,
      "mean_abs_error": 0.00013120261755830142,
      "max_rel_error_pct": 0.024710031132049483,
      "mean_rel_error_pct": 0.006064453410863199,
      "cosine_similarity": 0.9999999687879697,
      "mse": 2.659237872586003e-08,
      "snr_db": 72.02910861326299
    }
  ]
}

logs/performance_eval.log

  • 文件大小:672 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
=== convnext_base.clip_laion2b Performance Evaluation ===
Time: 2026-05-15 01:14:18
NPU: True (2x Ascend910_9362)
Loading model...
Model loaded in 5.66s

--- BS=1 ---
  Avg: 0.0148s  P50: 0.0148s  P90: 0.0148s
  Throughput: 67.58 img/s

--- BS=4 ---
  Avg: 0.0185s  P50: 0.0185s  P90: 0.0185s
  Throughput: 54.14 img/s

--- BS=8 ---
  Avg: 0.0241s  P50: 0.0241s  P90: 0.0241s
  Throughput: 41.50 img/s

--- BS=16 ---
  Avg: 0.0354s  P50: 0.0354s  P90: 0.0354s
  Throughput: 28.27 img/s

=== Summary ===
  bs1: avg=0.0148s thr=67.58
  bs4: avg=0.0185s thr=54.14
  bs8: avg=0.0241s thr=41.50
  bs16: avg=0.0354s thr=28.27
  NPU mem: 1297/62740MB

results/performance_eval.json

  • 文件大小:1916 bytes
  • 以下内容为 README 直接文本转写,不是外部路径引用。
{
  "model": "convnext_base.clip_laion2b",
  "device": "npu:0",
  "dtype": "float32",
  "npu_name": "Ascend910_9362",
  "input_size": [
    3,
    256,
    256
  ],
  "memory_before": {
    "free_mb": 61954.43,
    "total_mb": 62740.0,
    "used_mb": 785.57
  },
  "memory_after": {
    "free_mb": 61443.2,
    "total_mb": 62740.0,
    "used_mb": 1296.8
  },
  "per_batch_results": {
    "bs1": {
      "avg_time_sec": 0.01479809284210205,
      "std_time_sec": 1.5574427931613688e-05,
      "min_time_sec": 0.014770030975341797,
      "max_time_sec": 0.014820098876953125,
      "p50_sec": 0.01479792594909668,
      "p90_sec": 0.014817523956298827,
      "throughput_img_per_sec": 67.57627558295216,
      "num_runs": 10,
      "warmup": 3
    },
    "bs4": {
      "avg_time_sec": 0.018471336364746092,
      "std_time_sec": 1.5112503499940336e-05,
      "min_time_sec": 0.018435955047607422,
      "max_time_sec": 0.018497228622436523,
      "p50_sec": 0.018471956253051758,
      "p90_sec": 0.01848156452178955,
      "throughput_img_per_sec": 54.137934595169504,
      "num_runs": 10,
      "warmup": 3
    },
    "bs8": {
      "avg_time_sec": 0.024097180366516112,
      "std_time_sec": 2.174253261516977e-05,
      "min_time_sec": 0.02407360076904297,
      "max_time_sec": 0.024143457412719727,
      "p50_sec": 0.024092793464660645,
      "p90_sec": 0.024120068550109862,
      "throughput_img_per_sec": 41.49863115891914,
      "num_runs": 10,
      "warmup": 3
    },
    "bs16": {
      "avg_time_sec": 0.03537886142730713,
      "std_time_sec": 2.5946700831783115e-05,
      "min_time_sec": 0.035352468490600586,
      "max_time_sec": 0.035431861877441406,
      "p50_sec": 0.0353696346282959,
      "p90_sec": 0.03542327880859375,
      "throughput_img_per_sec": 28.265465864544506,
      "num_runs": 10,
      "warmup": 3
    }
  }
}

8. 许可证与声明

  • 适配代码许可证以本仓库 license 元数据或 LICENSE 文件为准。
  • 原始模型权重许可证以模型发布方为准。
  • 本仓库不应提交私钥、token、API key、缓存目录或大体积权重文件。
  • 文档中的运行结果来自仓库现有日志和 JSON 结果文件;未验证的数值不会在 README 中虚构。