基于多模态融合的鸟瞰图目标检测方法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

江苏省研究生科研与实践创新项目(SJCX25_0488,SJCX24_0464)


Aerial View Target Detection Method Based on Multi-modal Fusion
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对自动驾驶中复杂动态场景下目标检测与遮挡恢复困难的问题,提出一种融合鸟瞰图(Bird's-eye view,BEV)表示与3维占据网络(occupance network,OCC)的多模态数据融合感知框架。通过多视角图像生成伪点云补全遮挡区域,引入时序建模进行动态轨迹预测,并基于场景复杂度调整多模态特征融合权重,实现动态与静态物体的有效解耦检测。在特征融合阶段,采用稀疏注意力机制突出关键区域,增强对遮挡目标的感知能力。通过构建动态检测头与静态检测头,分别完成物体识别与轨迹预测任务。在NuScenes数据集上测试的结果表明:该方法在目标检测精度和遮挡物恢复方面优于现有主流方法,提升了系统在复杂环境下的鲁棒性与多任务感知能力,为高精度、高可靠的自动驾驶感知系统设计提供了有效参考。

    Abstract:

    Aiming at the difficulty of object detection and occlusion recovery in complex dynamic scenes of autonomous driving, this paper proposes a multimodal data fusion perception framework that integrates Bird's eye view (BEV) representation and three-dimensional occupancy network (OCC). The occlusion region is filled by the pseudo-point cloud generated from multi-view images, the dynamic trajectory network is predicted by introducing the time series modeling, and the multi-modal feature fusion weights are adjusted based on the scene complexity to realize the effective decoupling detection of dynamic and static objects. In the feature fusion stage, the sparse attention mechanism is used to highlight the key areas and enhance the perception of occluded objects. By constructing a dynamic detector and a static detector, the tasks of object recognition and trajectory prediction are completed respectively. The test results on NuScenes data set show that the proposed method is superior to the existing mainstream methods in target detection accuracy and occlusion recovery, and improves the robustness and multi-task perception ability of the system in complex environments, which provides an effective reference for the design of high-precision and high-reliability automatic driving perception system.

    参考文献
    相似文献
    引证文献
引用本文

夏庆锋.基于多模态融合的鸟瞰图目标检测方法[J].,2026,45(09).

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-01-06
  • 最后修改日期:2025-02-22
  • 录用日期:
  • 在线发布日期: 2026-09-28
  • 出版日期:
文章二维码