search
HomeTechnology peripheralsAIICCV 2023 announced the winners of popular papers such as ControlNet and 'Split Everything'

This week, the International Conference on Computer Vision (ICCV) opened in Paris, France.

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

As the world’s top academic conference in the field of computer vision, ICCV is held every two years.

Like CVPR, ICCV’s popularity has hit new highs.

At today's opening ceremony, ICCV officially announced this year's paper data: the total number of submissions to ICCV this year reached 8,068, of which 2,160 were accepted, with an acceptance rate of 26.8%. Slightly higher than the 25.9% acceptance rate of the previous ICCV 2021

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

Regarding the paper topic, the official also released relevant data: multi-view and sensor 3D technology is the most popular

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

In today’s opening ceremony, the most important part is to announce the award-winning information. Now, let us reveal the Best Paper, Best Paper Nomination and Best Student Paper one by one

Best Paper - Marr Award

Total Two papers won this year's best paper (Marr Prize).

The first article comes from researchers at the University of Toronto.

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖


  • Paper address: https://openaccess.thecvf.com/content/ICCV2023/ papers/Wei_Passive_Ultra-Wideband_Single-Photon_Imaging_ICCV_2023_paper.pdf
  • Authors: Mian Wei, Sotiris Nousias, Rahul Gulve, David B. Lindell, Kiriakos N. Kutulakos
  • Institution: University of Toronto

Abstract: This paper considers the problem of imaging dynamic scenes simultaneously at extreme time scales (seconds to picoseconds), and Imaging is done passively, without much light and without any timing signals from the light source that emits it. Since existing flux estimation techniques for single-photon cameras fail in this case, we develop a flux detection theory that draws insights from stochastic calculus to enable the Time-varying flux of reconstructed pixels in a stream of photon detection timestamps.

This paper uses this theory to show that passive free-running SPAD cameras have an achievable frequency bandwidth under low-flux conditions that spans the entire DC to 31 GHz range. At the same time, this paper also derives a novel Fourier domain flux reconstruction algorithm and ensures that the noise model of this algorithm is still effective under very low photon counts or non-negligible dead time

The potential of this asynchronous imaging mechanism is experimentally demonstrated: (1) No synchronization is required for imaging scenes illuminated simultaneously by light sources (such as light bulbs, projectors, multiple pulsed lasers) operating at different speeds; (2) Achieve passive non-line-of-sight video collection; (3) Record ultra-wideband video and later play it back at 30 Hz to show daily movement, or play it back a billion times slower to show the propagation of light itself

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

#The second article is what we know as ControNet.

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

  • ##Paper address: https://arxiv.org/pdf/2302.05543.pdf
  • Authors: Lvmin Zhang, Anyi Rao, Maneesh Agrawala
  • Institution: Stanford University

Abstract: This study proposes a An end-to-end neural network architecture called ControlNet. This architecture improves image generation by adding additional conditions to control the diffusion model (such as stable diffusion). At the same time, ControlNet can generate full-color images from line drawings, generate images with the same depth structure, and optimize hand generation effects through hand key points.

The core idea of ​​ControlNet is to add some additional conditions to the text description to control the diffusion model (such as Stable Diffusion), thereby better controlling the character pose, depth, picture structure and other information of the generated image.

The additional conditions here are input in the form of an image. The model can perform Canny edge detection, depth detection, semantic segmentation, Hough transform line detection, and overall nesting based on this input image. edge detection (HED), human pose recognition, etc., and then retain this information in the generated image. Using this model, we can directly convert line drawings or graffiti into full-color images, generate images with the same depth structure, etc., and optimize the generation of character hands through hand key points.

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

Please refer to Heart of the Machine's report "AI dimensionality reduction hits human painters, Vincentian graphs are introduced into ControlNet, and depth and edge information are fully reused" to Get a more detailed introduction

Best paper nomination: SAM

In April of this year, Meta released a paper called "Separate Everything (SAM) ” artificial intelligence model, which can generate masks for objects in any image or video, which shocked researchers in the field of computer vision. Some even said that “computer vision no longer exists”

Now, this high-profile paper is nominated for the best paper.

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

  • ##Paper address: https://arxiv.org/abs/2304.02643
  • Organization: Meta AI

Rewritten content: Before solving the segmentation problem, there are usually two methods. The first is interactive segmentation, which can be used to segment any class of objects but requires a human to guide the method by iteratively refining the mask. The second is automatic segmentation, which can be used to segment predefined specific object categories (such as cats or chairs), but requires a large number of manually annotated objects for training (such as thousands or even tens of thousands of examples of segmented cats). However, neither of these two methods provides a universal, fully automatic segmentation method

The SAM proposed by Meta nicely generalizes these two methods. It is a single model that can easily perform interactive segmentation and automatic segmentation. The model's promptable interface allows users to use it in a flexible way, enabling a wide range of segmentation tasks to be accomplished simply by designing the right prompts (clicks, box selections, text, etc.) for the model

To summarize, these features enable SAM to adapt to new tasks and domains. This flexibility is unique in the field of image segmentation

For details, please refer to the Heart of the Machine report: "CV Doesn't Exist?" Meta releases “split everything” AI model, CV may usher in GPT-3 moment》

Best Student Paper

The research was conducted by It was jointly completed by researchers from Cornell University, Google Research and UC Berkeley. The first work was Qianqian Wang, a doctoral student from Cornell Tech. They jointly proposed OmniMotion, a complete and globally consistent motion representation, and proposed a new test-time optimization method to perform accurate and complete motion estimation for every pixel in the video.

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

    ##Paper address: https://arxiv.org/abs/2306.05422
  • Project homepage: https://omnimotion.github.io/
Abstract: In the field of computer vision, there are two commonly used motion estimation methods: sparse feature tracking and dense light flow. However, both methods have their own shortcomings. Sparse feature tracking cannot model the motion of all pixels; dense optical flow cannot capture motion trajectories for a long time.

The OmniMotion proposed in this research uses a quasi-3D canonical volume to characterize the video and tracks each pixel through a bijection between local space and canonical space. This representation enables global consistency, enables motion tracking even when objects are occluded, and models any combination of camera and object motion. This study experimentally demonstrates that the proposed method significantly outperforms existing SOTA methods.

Please refer to the Heart of Machine report "The "track everything" video algorithm that tracks every pixel anytime, anywhere, and is not afraid of occlusion is here" for a more detailed introduction

In addition to these award-winning papers, this year’s ICCV also has many other outstanding papers worthy of everyone’s attention. The following is an initial list of the 17 winning papers

ICCV 2023宣布ControlNet和「分割一切」等热门论文获奖

The above is the detailed content of ICCV 2023 announced the winners of popular papers such as ControlNet and 'Split Everything'. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
You Must Build Workplace AI Behind A Veil Of IgnoranceYou Must Build Workplace AI Behind A Veil Of IgnoranceApr 29, 2025 am 11:15 AM

In John Rawls' seminal 1971 book The Theory of Justice, he proposed a thought experiment that we should take as the core of today's AI design and use decision-making: the veil of ignorance. This philosophy provides a simple tool for understanding equity and also provides a blueprint for leaders to use this understanding to design and implement AI equitably. Imagine that you are making rules for a new society. But there is a premise: you don’t know in advance what role you will play in this society. You may end up being rich or poor, healthy or disabled, belonging to a majority or marginal minority. Operating under this "veil of ignorance" prevents rule makers from making decisions that benefit themselves. On the contrary, people will be more motivated to formulate public

Decisions, Decisions… Next Steps For Practical Applied AIDecisions, Decisions… Next Steps For Practical Applied AIApr 29, 2025 am 11:14 AM

Numerous companies specialize in robotic process automation (RPA), offering bots to automate repetitive tasks—UiPath, Automation Anywhere, Blue Prism, and others. Meanwhile, process mining, orchestration, and intelligent document processing speciali

The Agents Are Coming – More On What We Will Do Next To AI PartnersThe Agents Are Coming – More On What We Will Do Next To AI PartnersApr 29, 2025 am 11:13 AM

The future of AI is moving beyond simple word prediction and conversational simulation; AI agents are emerging, capable of independent action and task completion. This shift is already evident in tools like Anthropic's Claude. AI Agents: Research a

Why Empathy Is More Important Than Control For Leaders In An AI-Driven FutureWhy Empathy Is More Important Than Control For Leaders In An AI-Driven FutureApr 29, 2025 am 11:12 AM

Rapid technological advancements necessitate a forward-looking perspective on the future of work. What happens when AI transcends mere productivity enhancement and begins shaping our societal structures? Topher McDougal's upcoming book, Gaia Wakes:

AI For Product Classification: Can Machines Master Tax Law?AI For Product Classification: Can Machines Master Tax Law?Apr 29, 2025 am 11:11 AM

Product classification, often involving complex codes like "HS 8471.30" from systems such as the Harmonized System (HS), is crucial for international trade and domestic sales. These codes ensure correct tax application, impacting every inv

Could Data Center Demand Spark A Climate Tech Rebound?Could Data Center Demand Spark A Climate Tech Rebound?Apr 29, 2025 am 11:10 AM

The future of energy consumption in data centers and climate technology investment This article explores the surge in energy consumption in AI-driven data centers and its impact on climate change, and analyzes innovative solutions and policy recommendations to address this challenge. Challenges of energy demand: Large and ultra-large-scale data centers consume huge power, comparable to the sum of hundreds of thousands of ordinary North American families, and emerging AI ultra-large-scale centers consume dozens of times more power than this. In the first eight months of 2024, Microsoft, Meta, Google and Amazon have invested approximately US$125 billion in the construction and operation of AI data centers (JP Morgan, 2024) (Table 1). Growing energy demand is both a challenge and an opportunity. According to Canary Media, the looming electricity

AI And Hollywood's Next Golden AgeAI And Hollywood's Next Golden AgeApr 29, 2025 am 11:09 AM

Generative AI is revolutionizing film and television production. Luma's Ray 2 model, as well as Runway's Gen-4, OpenAI's Sora, Google's Veo and other new models, are improving the quality of generated videos at an unprecedented speed. These models can easily create complex special effects and realistic scenes, even short video clips and camera-perceived motion effects have been achieved. While the manipulation and consistency of these tools still need to be improved, the speed of progress is amazing. Generative video is becoming an independent medium. Some models are good at animation production, while others are good at live-action images. It is worth noting that Adobe's Firefly and Moonvalley's Ma

Is ChatGPT Slowly Becoming AI's Biggest Yes-Man?Is ChatGPT Slowly Becoming AI's Biggest Yes-Man?Apr 29, 2025 am 11:08 AM

ChatGPT user experience declines: is it a model degradation or user expectations? Recently, a large number of ChatGPT paid users have complained about their performance degradation, which has attracted widespread attention. Users reported slower responses to models, shorter answers, lack of help, and even more hallucinations. Some users expressed dissatisfaction on social media, pointing out that ChatGPT has become “too flattering” and tends to verify user views rather than provide critical feedback. This not only affects the user experience, but also brings actual losses to corporate customers, such as reduced productivity and waste of computing resources. Evidence of performance degradation Many users have reported significant degradation in ChatGPT performance, especially in older models such as GPT-4 (which will soon be discontinued from service at the end of this month). this

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

SecLists

SecLists

SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft

PhpStorm Mac version

PhpStorm Mac version

The latest (2018.2.1) professional PHP integrated development tool