search
HomeTechnology peripheralsAIDenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloud

Original title: DenserRadar: A 4D millimeter-wave radar point cloud detector based on dense LiDAR point clouds

Paper link: https://arxiv.org/pdf/2405.05131

Author's unit: Tsinghua University

DenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloud

Thesis idea:

4D millimeter wave (mmWave) radar is used in extreme environments Its robustness, wide detection range, and ability to measure speed and altitude have shown significant potential to enhance perception when autonomous driving systems face corner-cases. However, the inherent sparsity and noise of 4D millimeter-wave radar point clouds limit its further development and practical applications. This paper introduces a novel 4D millimeter-wave radar point cloud detector that exploits high-resolution dense radar point clouds. Our method constructs dense 3D occupied space ground truth from stitched LiDAR point clouds and uses a specially designed network called DenserRadar. The proposed method surpasses existing probability-based and learning-based millimeter-wave radar point cloud detectors in terms of point cloud density and accuracy, achieving better results on the K-Radar dataset.

Main contribution:

The work of this paper is the first 4D millimeter wave radar point cloud detector supervised by dense 3D occupied data space ground truth. Generated by splicing multi-frame LiDAR point clouds, thereby densifying the detected millimeter wave radar point cloud.

This paper proposes an innovative dense snow 3D occupied data space ground truth generation process, and the splicing of dense LiDAR point clouds of the K-Radar dataset. These point clouds provide comprehensive scene ground truth. In the publication will be available for further research.

Due to the special design of the DenserRadar network, the algorithm in this article is superior to existing CFAR type and learning-based millimeter wave radar point cloud detection methods in terms of point cloud density and accuracy.

Network Design:

Autonomous driving technology aims to provide a safe, convenient and comfortable transportation experience, and its development speed is impressive. To achieve high-level autonomous driving, the ability to perceive and position complex environments is indispensable. Therefore, the sensors equipped on autonomous vehicles, including cameras, lidar (LiDAR) and millimeter-wave radar, as well as their related algorithms, are attracting more and more research interest.

Given its advantages such as compact size, high cost-effectiveness, all-weather adaptability, speed measurement capability, and wide detection range [1], millimeter wave (mmWave) radar has been widely used in the field of autonomous driving. Recent advances in multiple-input multiple-output (MIMO) antenna technology have further improved height resolution, enabling the emergence of 4D millimeter-wave radar. Therefore, 4D millimeter-wave radar is increasingly regarded as a key enhancement of perception and positioning capabilities in autonomous driving, especially in challenging edge scenes such as rain, snow, and fog. As its name suggests, 4D millimeter wave radar can measure four dimensions of target information: range, azimuth, altitude and Doppler velocity, providing a comprehensive sensing solution.

However, the quality of 4D millimeter wave radar point clouds lags significantly behind lidar point clouds. First of all, 4D millimeter wave radar point clouds have low resolution problems, especially in angle measurement. This limitation is mainly due to the antenna configuration and direction of arrival (DOA) estimation of mmWave radar [2]. Secondly, 4D millimeter wave radar point clouds are much sparser than lidar point clouds. Third, due to multipath effects, signal interference and ground reflection, 4D millimeter wave radar point clouds often contain a large number of clutter points. All these shortcomings hinder the application of 4D millimeter wave radar in autonomous driving.

The quality of 4D millimeter wave radar point clouds is not only limited by hardware, but also by signal processing algorithms [3]. In particular, detecting real targets from raw radargrams or tensors to generate point clouds can greatly impact quality. Traditionally, the False Alarm Rate (CFAR) detector and its variants [4], [5] are widely used in the detection of millimeter wave radar point clouds. However, as a probability-based algorithm, CFAR-type detectors may encounter problems when detecting objects of different sizes because these objects are not independent and identically distributed [6], which often occurs in autonomous driving scenarios.

In order to solve the point cloud quality issues related to 4D millimeter wave radar, this paper proposes a learning-based 4D millimeter wave radar point cloud detector, which is composed of dense real-life data generated from lidar point clouds. Information supervision. Initially, this paper stitches multiple frames of pre-processed LiDAR point clouds to generate dense 3D occupancy ground truth. This article then introduces the DenserRadar network, which extracts the features of the original 4D millimeter wave radar tensor and generates a denser and more accurate 4D millimeter wave radar point cloud. The network employs a weighted hybrid loss function along with other novel design elements to capture multi-resolution features and generate point clouds with better resolution than traditional techniques. Comparative experiments conducted on the K-Radar data set [7] prove the effectiveness of this method.

The algorithm of this article is shown in Figure 1. First, this paper designs a ground truth generation process to obtain dense 3D occupied space ground truth as supervision information by splicing multi-frame lidar point cloud data, and then establishes the DenserRadar network, which is tasked with generating data from the original 4D millimeter wave Detection of millimeter wave radar point clouds in radar tensor data.

DenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloud

Figure 1. Overview of the entire algorithm.

DenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloud

Figure 2. Truth value generation flow chart.

Experimental results:

DenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloud

Figure 4. Qualitative point cloud comparison between the DenserRadar algorithm and the CA-CFAR algorithm in this article, attached Images and dense 3D space-occupying ground truth point clouds are used as reference. Each arrow in the diagram represents a length of 10 meters.

DenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloudDenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloudDenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloud

Summary:

This article introduces DenserRadar, a novel 4D millimeter wave radar point Cloud detection networks, and an innovative process for generating dense ground truth. Experimental results and ablation studies demonstrate the effectiveness of our network architecture and ground truth generation methodology. This research has the potential to improve the perception and localization capabilities of autonomous driving systems, especially in challenging edge-case scenarios.

The above is the detailed content of DenserRadar: 4D millimeter wave radar point cloud detector based on dense LiDAR point cloud. For more information, please follow other related articles on the PHP Chinese website!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
轻松拿捏 4K 高清图像理解!这个多模态大模型自动分析网页海报内容,打工人简直不要太方便轻松拿捏 4K 高清图像理解!这个多模态大模型自动分析网页海报内容,打工人简直不要太方便Apr 23, 2024 am 08:04 AM

一个可以自动分析PDF、网页、海报、Excel图表内容的大模型,对于打工人来说简直不要太方便。上海AILab,香港中文大学等研究机构提出的InternLM-XComposer2-4KHD(简写为IXC2-4KHD)模型让这成为了现实。相比于其他多模态大模型不超过1500x1500的分辨率限制,该工作将多模态大模型的最大输入图像提升到超过4K(3840x1600)分辨率,并支持任意长宽比和336像素~4K动态分辨率变化。发布三天,该模型就登顶HuggingFace视觉问答模型热度榜单第一。轻松拿捏

LiDAR仿真新思路 | LidarDM:助力4D世界生成,仿真杀器~LiDAR仿真新思路 | LidarDM:助力4D世界生成,仿真杀器~Apr 12, 2024 am 11:46 AM

原标题:LidarDM:GenerativeLiDARSimulationinaGeneratedWorld论文链接:https://arxiv.org/pdf/2404.02903.pdf代码链接:https://github.com/vzyrianov/lidardm作者单位:伊利诺伊大学麻省理工学院论文思路:本文介绍了LidarDM,这是一种新颖的激光雷达生成模型,能够产生逼真、布局感知、物理可信以及时间上连贯的激光雷达视频。LidarDM在激光雷达生成建模方面具有两个前所未有的能力:(一

超越BEVFormer!CR3DT:RV融合助力3D检测&跟踪新SOTA(ETH)超越BEVFormer!CR3DT:RV融合助力3D检测&跟踪新SOTA(ETH)Apr 24, 2024 pm 06:07 PM

写在前面&笔者的个人理解本文介绍了一种用于3D目标检测和多目标跟踪的相机-毫米波雷达融合方法(CR3DT)。基于激光雷达的方法已经为这一领域奠定了一个高标准,但是它的高算力、高成本的缺陷制约了该方案在自动驾驶领域的发展;基于相机的3D目标检测和跟踪方案由于其成本较低,也吸引了许多学者的关注,但是由于其成果效果差。因此,将相机与毫米波雷达的融合正在成为一个很有前景的方案。作者在现有的相机框架BEVDet下,融合毫米波雷达的空间和速度信息,结合CC-3DT++跟踪头,显著提高了3D目标检测和跟踪的精

RV融合性能拉爆!RCBEVDet:Radar也有春天,最新SOTA!RV融合性能拉爆!RCBEVDet:Radar也有春天,最新SOTA!Apr 02, 2024 am 11:49 AM

写在前面&笔者的个人理解这篇讨论文关注的主要问题是3D目标检测技术在自动驾驶进程中的应用。尽管环境视觉相机技术的发展为3D目标检测提供了高分辨率的语义信息,这种方法因无法精确捕获深度信息和在恶劣天气或低光照条件下的表现不佳等问题而受限。针对这一问题,讨论提出了一种结合环视相机和经济型毫米波雷达传感器的多模式3D目标检测新方法——RCBEVDet。该方法通过综合使用多传感器的信息,提供了更丰富的语义信息以及在恶劣天气或低光照条件下的表现不佳等问题的解决方案。针对这一问题,讨论提出了一种结合环视相机

CVPR 2024 | 面向真实感场景生成的激光雷达扩散模型CVPR 2024 | 面向真实感场景生成的激光雷达扩散模型Apr 24, 2024 pm 04:28 PM

原标题:TowardsRealisticSceneGenerationwithLiDARDiffusionModels论文链接:https://hancyran.github.io/assets/paper/lidar_diffusion.pdf代码链接:https://lidar-diffusion.github.io作者单位:CMU丰田研究院南加州大学论文思路:扩散模型(DMs)在逼真的图像合成方面表现出色,但将其适配到激光雷达场景生成中存在临着重大挑战。这主要是因为在点空间运作的DMs难以

「深度解析」:探究自动驾驶中的激光雷达点云分割算法「深度解析」:探究自动驾驶中的激光雷达点云分割算法Apr 23, 2023 pm 04:46 PM

目前常见的激光点云分割算法有基于平面拟合的方法和基于激光点云数据特点的方法两类。具体如下:点云地面分割算法01基于平面拟合的方法-GroundPlaneFitting算法思想:一种简单的处理方法就是沿着x方向(车头的方向)将空间分割成若干个子平面,然后对每个子平面使用地面平面拟合算法(GPF)从而得到能够处理陡坡的地面分割方法。该方法是在单帧点云中拟合全局平面,在点云数量较多时效果较好,点云稀疏时极易带来漏检和误检,比如16线激光雷达。算法伪代码:伪代码算法流程是对于给定的点云P,分割的最终结果

恶劣天气条件下激光雷达感知技术方案恶劣天气条件下激光雷达感知技术方案May 10, 2023 pm 04:07 PM

01摘要自动驾驶汽车依靠各种传感器来收集周围环境的信息。车辆的行为是根据环境感知进行规划的,因此出于安全考虑,其可靠性至关重要。有源激光雷达传感器能够创建场景的精确3D表示,使其成为自动驾驶汽车环境感知的宝贵补充。由于光散射和遮挡,激光雷达的性能在雾、雪或雨等恶劣天气条件下会发生变化。这种限制最近促进了大量关于缓解感知性能下降的方法的研究。本文收集、分析并讨论了基于激光雷达的环境感知中应对不利天气条件的不同方面。并讨论了适当数据的可用性、原始点云处理和去噪、鲁棒感知算法和传感器融合等主题,以缓解

Java实现的雷达信号处理技术介绍Java实现的雷达信号处理技术介绍Jun 18, 2023 am 10:15 AM

导读:随着现代科技的不断发展,雷达信号处理技术得到日益广泛的应用。Java作为目前最流行的编程语言之一,被广泛用于雷达信号处理算法的实现,本文就介绍一下Java实现的雷达信号处理技术。一、雷达信号处理技术简介雷达信号处理技术可以说是雷达系统发展的核心和灵魂,是实现雷达系统自动化、数字化的关键技术。雷达信号处理技术包含波形处理、滤波处理、脉冲压缩、自适应波束形

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
3 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
3 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. How to Fix Audio if You Can't Hear Anyone
3 weeks agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Atom editor mac version download

Atom editor mac version download

The most popular open source editor

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.

EditPlus Chinese cracked version

EditPlus Chinese cracked version

Small size, syntax highlighting, does not support code prompt function