OpenLET/LET-Dex-Dataset
数据集数据集查看器文件和版本Pull Requests讨论
下载使用量0

LET-Dex-Dataset: 全尺寸人形机器人灵巧手力觉触觉数据集

Full-Size Humanoid Robot Dexterous Hand Tactile Dataset

简体中文 | English


Highlights

  • 约 3,000 条 ROSbag 数据,覆盖灵巧手遥操作、触觉阵列与六维力数据
  • 14 个子任务目录 覆盖汽车制造、物流快递、工业质检、桌面整理、快消品上料等场景
  • 14 种原子技能、约 8,400 个步骤级 marks,包含抓取 (capture)、放置 (placement)、按压 (press)、扫描 (scanning) 等
  • 累计操作时长约 20 小时(含缺失步骤时长估算)
  • 当前数据规模约 707 GB,采用 ROSbag + 语义标注组织
  • 指尖触觉阵列 6×12×5 传感器,360 触觉单元实时感知
  • 完整工具链 从 rosbag 转换、模型训练到推理部署,开箱即用

硬件平台

Kuavo 4 Pro Linker Hand L6

基于 Kuavo 4 Pro 人形机器人 + Linker Hand L6 灵巧手采集:

参数规格
身高 / 体重1.66m / 55kg
自由度40 DoF
灵巧手Linker Hand L6(6主动+5被动关节)
触觉传感器6×12×5 指尖阵列,360 单元
力觉传感器六维力/力矩(Fxyz + Mxyz)
视觉三视角 RGB-D(头部/左腕/右腕)

数据概览

数据规模

维度数量
已标注任务目录14
ROSbag 数据约 3,000 条
步骤级 marks约 8,400
累计操作时长约 20 小时
原子技能种类14
数据容量约 707 GB
数据格式ROSbag + 语义标注
末端类型Linker Hand L6 灵巧手

任务详情

任务目录中文名称场景数据条数时长
Clean-up_desktop_items-P4-Linker_Hand_L6灵心巧手桌面物品整理家庭服务1717 min
Load_it_up-P4-Linker_Hand_L6汽车钣金上料汽车工厂28131 min
Package_scan-P4-Linker_Hand_L6顺丰快递扫码物流276106 min
Push_The_Cardboard_Box_To_The_Position_With_Resistance-P4-Linker_Hand_L6基于6维力的推纸箱到有阻力位置汽车工厂272≈126 min
SF_Express_Parcel_Sorting-P4-Linker_Hand_L6灵心巧手顺丰包裹分拣物流19878 min
Smart_postal_packages-P4-Linker_Hand_L6灵心巧手邮政包裹分拣物流12132 min
Smartandfast-forward-P4-Linker_Hand_L6灵心巧手快消品标准上料快消品6967 min
Task_mass_check-P4-Linker_Hand_L6舍弗勒产品质检工业质检9554 min
Toothpaste_Box_Feeding-P4-Linker_Hand_L6L6机械臂-牙膏盒上料快消品29871 min
Toothpaste_Box_Storage_01-P4-Linker_Hand_L6L6机械臂-牙膏盒收纳快消品21428 min
Toothpaste_Box_Storage_02-P4-Linker_Hand_L6L6机械臂-牙膏盒收纳快消品25022 min
Unilever_FMCG_Standard_Feeding-P4-Linker_Hand_L6快消品标准上料(联合利华)快消品288488 min
Water_Bottle_Delivery-P4-Linker_Hand_L6L6机械臂-递水瓶家庭服务279≈51 min
Wipe_The_Blackboard-P4-Linker_Hand_L6L6机械臂-擦黑板生活服务25031 min

注:数据条数按 ROSbag 文件统计;时长优先由步骤级 duration 汇总,≈ 表示根据 ROSbag 文件名时间间隔估算。output.txt 等辅助文件不计入统计。

场景覆盖

场景领域代表任务
汽车工厂钣金上料、推纸箱
物流快递快递扫描、包裹分拣、邮政分拣
快消品牙膏盒上料/收纳、快消品上料、联合利华上料
工业质检舍弗勒产品质检
家庭服务桌面整理、递水瓶
生活服务擦黑板

原子技能分布

原子技能出现次数说明
capture3,476抓取/捕获
placement2,625放置操作
fall back379回退
pick up358拾取
peace291平稳操作
press283按压
wipe251擦拭
wait216等待
plot198轨迹规划
scanning121扫描
catch82接取
initial69初始位姿
adjustment49调整/校准
set36就位设置

语义标注

每条轨迹的语义标注主要由轨迹级元信息和步骤级 marks 数组组成,常见语义样例如下:

  • 场景样例 — 家庭生活、工业制造;清洁整理、生产物流;餐桌清洁、流水线上料
  • 任务样例 — 灵心巧手桌面物品整理、汽车钣金上料、顺丰快递扫码、舍弗勒产品质检、快消品标准上料(联合利华)
  • 技能样例 — placement、capture、press、pick up、fall back、wipe、wait、scanning

语义标注示例(节选):

{
  "location": "北京训练场-A10",
  "primaryScene": "家庭生活-H",
  "primarySceneCode": "FAMILY LIFE - H",
  "secondaryScene": "清洁整理-C",
  "secondarySceneCode": "CLEANING - C",
  "tertiaryScene": "餐桌清洁-05",
  "tertiarySceneCode": "Table cleaning-05",
  "initSceneText": "餐桌清洁",
  "englishInitSceneText": "Table cleaning",
  "taskGroupName": "",
  "taskGroupCode": "",
  "taskName": "灵心巧手桌面物品整理",
  "taskCode": "Clean-up desktop items",
  "deviceSn": "p4-353",
  "taskPrompt": "",
  "marks": [
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:38:48.719",
      "markEnd": "2025-12-19 10:38:58.802",
      "duration": 10.083,
      "startPosition": "0.0017753813694877166",
      "endPosition": "0.18258613462251694",
      "skillAtomic": "pick up",
      "skillDetail": "初始双手置于胸前。右手将桌面的抹布拿起",
      "enSkillDetail": "initial hands on the chest. right hand picks up the rag of the desktop",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:38:58.802",
      "markEnd": "2025-12-19 10:39:01.808",
      "duration": 3.006,
      "startPosition": "0.18258613462251694",
      "endPosition": "0.23649765320502625",
      "skillAtomic": "placement",
      "skillDetail": "根据物品种类将抹布放置在右手边的收纳箱中",
      "enSkillDetail": "place the rag in the box on the right side according to the type of item",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:01.808",
      "markEnd": "2025-12-19 10:39:07.892",
      "duration": 6.084,
      "startPosition": "0.23649765320502625",
      "endPosition": "0.34559571995346183",
      "skillAtomic": "pick up",
      "skillDetail": "右手将桌面的圆形海绵球物品拿起",
      "enSkillDetail": "right hand picks up the table's spongeball articles",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:07.892",
      "markEnd": "2025-12-19 10:39:11.002",
      "duration": 3.11,
      "startPosition": "0.34559571995346183",
      "endPosition": "0.4013777582532286",
      "skillAtomic": "placement",
      "skillDetail": "根据物品种类将圆形海绵球放置在右手边的收纳箱中",
      "enSkillDetail": "place a circular sponge ball in the box on the right hand according to the type of object",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:11.002",
      "markEnd": "2025-12-19 10:39:20.818",
      "duration": 9.816,
      "startPosition": "0.4013777582532286",
      "endPosition": "0.5774127670053398",
      "skillAtomic": "pick up",
      "skillDetail": "左手将桌面的香蕉拿起",
      "enSkillDetail": "take the bananas from the desktop in the left hand",
      "markType": "step"
    },
    {
      "taskId": "2001489017564172288",
      "markStart": "2025-12-19 10:39:20.818",
      "markEnd": "2025-12-19 10:39:27.123",
      "duration": 6.305,
      "startPosition": "0.5774127670053398",
      "endPosition": "0.6904757476850609",
      "skillAtomic": "placement",
      "skillDetail": "根据物品种类将香蕉放置在左手边的收纳箱中",
      "enSkillDetail": "bananas placed in the box on the left side according to the type of item",
      "markType": "step"
    }
  ]
}

目录结构

LET-Dex-Dataset/
├── datasets/
│   ├── Clean-up_desktop_items-P4-Linker_Hand_L6/
│   ├── Load_it_up-P4-Linker_Hand_L6/
│   ├── Package_scan-P4-Linker_Hand_L6/
│   ├── Push_The_Cardboard_Box_To_The_Position_With_Resistance-P4-Linker_Hand_L6/
│   ├── SF_Express_Parcel_Sorting-P4-Linker_Hand_L6/
│   ├── Smart_postal_packages-P4-Linker_Hand_L6/
│   ├── Smartandfast-forward-P4-Linker_Hand_L6/
│   ├── Task_mass_check-P4-Linker_Hand_L6/
│   ├── Toothpaste_Box_Feeding-P4-Linker_Hand_L6/
│   ├── Toothpaste_Box_Storage_01-P4-Linker_Hand_L6/
│   ├── Toothpaste_Box_Storage_02-P4-Linker_Hand_L6/
│   ├── Unilever_FMCG_Standard_Feeding-P4-Linker_Hand_L6/
│   ├── Water_Bottle_Delivery-P4-Linker_Hand_L6/
│   └── Wipe_The_Blackboard-P4-Linker_Hand_L6/
├── docs/
├── README.md
└── README_EN.md

命名规范:<英文任务名>-<机器人型号>-<末端类型>

每个任务目录下包含 .bag ROSbag 数据和同名语义标注文件;output.txt 等辅助文件不计入数据规模统计。


数据格式

ROSbag Topics

触觉 (Tactile)

Topic类型说明
/cb_$pos_hand_control_cmdJointState手部控制指令(6关节)
/cb_$pos_hand_stateJointState手部状态返回
/cb_$pos_hand_matrix_touch_pc2PointCloud2触觉矩阵(360单元)
/force6d_$pos_hand_force_torqueWrenchStamped六维力/力矩

通用 (Touch)

Topic类型说明
/cam_{h,l,r}/color/image_raw/compressedCompressedImage头/左腕/右腕 RGB
/cam_{h,l,r}/depth/image_rect_raw/compressedCompressedImage头/左腕/右腕 深度
/kuavo_arm_trajJointState手臂轨迹 (14 DoF)
/sensors_data_rawsensorsData全关节状态 + IMU
/control_robot_hand_positionrobotHandPosition灵巧手位置
/dexhand/stateJointState灵巧手状态(12 DoF)

快速上手

工具仓库

我们提供完整的开源工具链 kuavo_data_challenge:

  • rosbag2lerobot — ROSbag → LeRobot 格式转换
  • Diffusion Policy / ACT — 两种模仿学习基线
  • 训练脚本 — 开箱即用的训练 pipeline
  • 部署工具 — 真机与仿真环境推理

数据获取

平台链接
AtomgitOpenLET/LET-Dex-Dataset

社区

QQ 交流群:1043359345


引用

如在研究中使用本数据集,请引用:

Atomgit 引用

@misc{LET_Dex2025,
    title={LET-Dex-Dataset:Full-Size Humanoid Robot Dexterous Hand Tactile Dataset},
    author={LejuRobotics},
    year={2025},
    howpublished={\url{https://ai.atomgit.com/OpenLET/LET-Dex-Dataset}}
}

许可证

CC BY-NC-SA 4.0