HuggingFace镜像/HRNetPose
模型介绍文件和版本分析
下载使用量0

HRNetPose 模型演示

HRNetPose:为高通设备优化

HRNet 采用高分辨率表示进行姿态估计。

本模型基于 此处 提供的 HRNetPose 实现。 此仓库包含为 Qualcomm® 设备优化的预导出模型文件。您可以使用 Qualcomm® AI Hub Models 库,通过自定义配置进行导出。有关模型在各种设备上的性能详情,请参见 性能摘要。

Qualcomm AI Hub Models 使用 Qualcomm AI Hub Workbench 对此模型进行编译、分析和评估。立即注册,即可在托管的 Qualcomm® 设备上运行这些模型。

快速开始

有两种方式可在您的设备上部署此模型:

选项 1:下载预导出模型

以下是可直接部署的预导出模型资源。

运行时精度芯片组SDK 版本下载
ONNXfloat通用QAIRT 2.42、ONNX Runtime 1.24.3下载
ONNXw8a16通用QAIRT 2.42、ONNX Runtime 1.24.3下载
ONNXw8a8通用QAIRT 2.42、ONNX Runtime 1.24.3下载
QNN_DLCfloat通用QAIRT 2.45下载
QNN_DLCw8a16通用QAIRT 2.45下载
QNN_DLCw8a8通用QAIRT 2.45下载
TFLITEfloat通用QAIRT 2.45下载
TFLITEw8a8通用QAIRT 2.45下载

如需更多设备特定资源和性能指标,请访问 Qualcomm® AI Hub 上的 HRNetPose。

选项 2:使用自定义配置导出

使用 Qualcomm® AI Hub Models Python 库编译和导出模型,并可自定义以下内容:

  • 自定义权重(例如,微调后的检查点)
  • 自定义输入形状
  • 目标设备和运行时配置

如果您需要在本文提供的默认配置基础上进一步自定义模型,此选项非常适用。

有关使用说明,请参见我们 GitHub 上的 HRNetPose 仓库。

模型详情

模型类型: Model_use_case.pose_estimation

模型统计信息:

  • 模型检查点:hrnet_posenet_FP32_state_dict
  • 输入分辨率:256x192
  • 参数数量:28.5M
  • 模型大小(浮点型):109 MB
  • 模型大小(w8a8):28.1 MB

性能摘要

模型运行时精度芯片组推理时间(毫秒)峰值内存范围(MB)主要计算单元
HRNetPoseONNXfloatSnapdragon® 8 Elite Gen 5 Mobile1.217 ms1 - 91 MBNPU
HRNetPoseONNXfloatSnapdragon® X2 Elite1.328 ms55 - 55 MBNPU
HRNetPoseONNXfloatSnapdragon® X Elite2.625 ms55 - 55 MBNPU
HRNetPoseONNXfloatSnapdragon® 8 Gen 3 Mobile1.848 ms0 - 148 MBNPU
HRNetPoseONNXfloatQualcomm® QCS8550 (Proxy)2.466 ms0 - 58 MBNPU
HRNetPoseONNXfloatQualcomm® QCS90753.912 ms0 - 4 MBNPU
HRNetPoseONNXfloatSnapdragon® 8 Elite For Galaxy Mobile1.503 ms0 - 93 MBNPU
HRNetPoseONNXw8a16Snapdragon® 8 Elite Gen 5 Mobile0.788 ms0 - 129 MBNPU
HRNetPoseONNXw8a16Snapdragon® X2 Elite1.013 ms28 - 28 MBNPU
HRNetPoseONNXw8a16Snapdragon® X Elite1.987 ms28 - 28 MBNPU
HRNetPoseONNXw8a16Snapdragon® 8 Gen 3 Mobile1.255 ms0 - 199 MBNPU
HRNetPoseONNXw8a16Qualcomm® QCS6490480.354 ms30 - 34 MBCPU
HRNetPoseONNXw8a16Qualcomm® QCS8550 (Proxy)1.761 ms0 - 38 MBNPU
HRNetPoseONNXw8a16Qualcomm® QCS90751.989 ms0 - 3 MBNPU
HRNetPoseONNXw8a16Qualcomm® QCM6690223.1 ms30 - 48 MBCPU
HRNetPoseONNXw8a16Snapdragon® 8 Elite For Galaxy Mobile0.972 ms0 - 124 MBNPU
HRNetPoseONNXw8a16Snapdragon® 7 Gen 4 Mobile214.16 ms26 - 41 MBCPU
HRNetPoseONNXw8a8Snapdragon® 8 Elite Gen 5 Mobile0.806 ms0 - 122 MBNPU
HRNetPoseONNXw8a8Snapdragon® X2 Elite0.77 ms30 - 30 MBNPU
HRNetPoseONNXw8a8Snapdragon® X Elite1.632 ms28 - 28 MBNPU
HRNetPoseONNXw8a8Snapdragon® 8 Gen 3 Mobile1.046 ms0 - 186 MBNPU
HRNetPoseONNXw8a8Qualcomm® QCS649089.757 ms8 - 68 MBCPU
HRNetPoseONNXw8a8Qualcomm® QCS8550 (Proxy)1.513 ms0 - 33 MBNPU
HRNetPoseONNXw8a8Qualcomm® QCS90751.542 ms0 - 3 MBNPU
HRNetPoseONNXw8a8Qualcomm® QCM669060.819 ms9 - 30 MBCPU
HRNetPoseONNXw8a8Snapdragon® 8 Elite For Galaxy Mobile0.912 ms0 - 114 MBNPU
HRNetPoseONNXw8a8Snapdragon® 7 Gen 4 Mobile58.162 ms10 - 30 MBCPU
HRNetPoseQNN_DLCfloatSnapdragon® 8 Elite Gen 5 Mobile1.266 ms1 - 77 MBNPU
HRNetPoseQNN_DLCfloatSnapdragon® X2 Elite1.689 ms1 - 1 MBNPU
HRNetPoseQNN_DLCfloatSnapdragon® X Elite2.937 ms1 - 1 MBNPU
HRNetPoseQNN_DLCfloatSnapdragon® 8 Gen 3 Mobile1.991 ms0 - 117 MBNPU
HRNetPoseQNN_DLCfloatQualcomm® QCS8275 (Proxy)14.17 ms1 - 73 MBNPU
HRNetPoseQNN_DLCfloatQualcomm® QCS8550 (Proxy)2.776 ms1 - 2 MBNPU
HRNetPoseQNN_DLCfloatQualcomm® SA8775P4.291 ms1 - 75 MBNPU
HRNetPoseQNN_DLCfloatQualcomm® QCS90754.105 ms1 - 3 MBNPU
HRNetPoseQNN_DLCfloatQualcomm® QCS8450 (Proxy)5.016 ms0 - 103 MBNPU
HRNetPoseQNN_DLCfloatQualcomm® SA7255P14.17 ms1 - 73 MBNPU
HRNetPoseQNN_DLCfloatQualcomm® SA8295P4.581 ms1 - 61 MBNPU
HRNetPoseQNN_DLCfloatSnapdragon® 8 Elite For Galaxy Mobile1.561 ms0 - 73 MBNPU
HRNetPoseQNN_DLCw8a16Snapdragon® 8 Elite Gen 5 Mobile0.809 ms0 - 101 MBNPU
HRNetPoseQNN_DLCw8a16Snapdragon® X2 Elite1.307 ms0 - 0 MBNPU
HRNetPoseQNN_DLCw8a16Snapdragon® X Elite2.141 ms0 - 0 MBNPU
HRNetPoseQNN_DLCw8a16Snapdragon® 8 Gen 3 Mobile1.368 ms0 - 147 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® QCS64906.463 ms0 - 2 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® QCS8275 (Proxy)5.154 ms0 - 100 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® QCS8550 (Proxy)1.867 ms0 - 2 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® SA8775P2.255 ms0 - 102 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® QCS90752.179 ms2 - 4 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® QCM669019.73 ms0 - 218 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® QCS8450 (Proxy)2.727 ms0 - 149 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® SA7255P5.154 ms0 - 100 MBNPU
HRNetPoseQNN_DLCw8a16Qualcomm® SA8295P3.071 ms0 - 99 MBNPU
HRNetPoseQNN_DLCw8a16Snapdragon® 8 Elite For Galaxy Mobile1.019 ms0 - 100 MBNPU
HRNetPoseQNN_DLCw8a16Snapdragon® 7 Gen 4 Mobile2.548 ms0 - 101 MBNPU
HRNetPoseQNN_DLCw8a8Snapdragon® 8 Elite Gen 5 Mobile0.546 ms0 - 94 MBNPU
HRNetPoseQNN_DLCw8a8Snapdragon® X2 Elite0.719 ms0 - 0 MBNPU
HRNetPoseQNN_DLCw8a8Snapdragon® X Elite1.267 ms0 - 0 MBNPU
HRNetPoseQNN_DLCw8a8Snapdragon® 8 Gen 3 Mobile0.824 ms0 - 133 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® QCS64903.73 ms0 - 2 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® QCS8275 (Proxy)2.837 ms0 - 90 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® QCS8550 (Proxy)1.127 ms0 - 2 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® SA8775P1.502 ms0 - 91 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® QCS90751.282 ms0 - 2 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® QCM669010.449 ms0 - 213 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® QCS8450 (Proxy)1.734 ms0 - 135 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® SA7255P2.837 ms0 - 90 MBNPU
HRNetPoseQNN_DLCw8a8Qualcomm® SA8295P1.952 ms0 - 88 MBNPU
HRNetPoseQNN_DLCw8a8Snapdragon® 8 Elite For Galaxy Mobile0.642 ms0 - 92 MBNPU
HRNetPoseQNN_DLCw8a8Snapdragon® 7 Gen 4 Mobile1.513 ms0 - 90 MBNPU
HRNetPoseTFLITEfloatSnapdragon® 8 Elite Gen 5 Mobile1.277 ms0 - 113 MBNPU
HRNetPoseTFLITEfloatSnapdragon® 8 Gen 3 Mobile1.988 ms0 - 184 MBNPU
HRNetPoseTFLITEfloatQualcomm® QCS8275 (Proxy)14.166 ms0 - 111 MBNPU
HRNetPoseTFLITEfloatQualcomm® QCS8550 (Proxy)2.766 ms0 - 2 MBNPU
HRNetPoseTFLITEfloatQualcomm® SA8775P4.338 ms0 - 111 MBNPU
HRNetPoseTFLITEfloatQualcomm® QCS90754.147 ms0 - 58 MBNPU
HRNetPoseTFLITEfloatQualcomm® QCS8450 (Proxy)5.029 ms0 - 174 MBNPU
HRNetPoseTFLITEfloatQualcomm® SA7255P14.166 ms0 - 111 MBNPU
HRNetPoseTFLITEfloatQualcomm® SA8295P4.624 ms0 - 103 MBNPU
HRNetPoseTFLITEfloatSnapdragon® 8 Elite For Galaxy Mobile1.548 ms0 - 112 MBNPU
HRNetPoseTFLITEw8a8Snapdragon® 8 Elite Gen 5 Mobile0.513 ms0 - 91 MBNPU
HRNetPoseTFLITEw8a8Snapdragon® 8 Gen 3 Mobile0.712 ms0 - 140 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® QCS64903.444 ms0 - 30 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® QCS8275 (Proxy)2.547 ms0 - 87 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® QCS8550 (Proxy)0.952 ms0 - 3 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® SA8775P1.355 ms0 - 89 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® QCS90751.081 ms0 - 30 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® QCM66909.629 ms0 - 207 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® QCS8450 (Proxy)1.523 ms0 - 142 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® SA7255P2.547 ms0 - 87 MBNPU
HRNetPoseTFLITEw8a8Qualcomm® SA8295P1.792 ms0 - 85 MBNPU
HRNetPoseTFLITEw8a8Snapdragon® 8 Elite For Galaxy Mobile0.586 ms0 - 88 MBNPU
HRNetPoseTFLITEw8a8Snapdragon® 7 Gen 4 Mobile1.355 ms0 - 85 MBNPU

许可协议

  • HRNetPose 原始实现的许可协议可在 此处 找到。

参考文献

  • Deep High-Resolution Representation Learning for Human Pose Estimation
  • Source Model Implementation

社区

  • 加入 我们的 AI Hub Slack 社区,进行协作、提问并了解更多关于设备端 AI 的信息。
  • 如有问题或反馈,请 联系我们。