


ICCV 2023 announced the winners of popular papers such as ControlNet and 'Split Everything'
This week, the International Conference on Computer Vision (ICCV) opened in Paris, France.
As the world’s top academic conference in the field of computer vision, ICCV is held every two years.
Like CVPR, ICCV’s popularity has hit new highs.
At today's opening ceremony, ICCV officially announced this year's paper data: the total number of submissions to ICCV this year reached 8,068, of which 2,160 were accepted, with an acceptance rate of 26.8%. Slightly higher than the 25.9% acceptance rate of the previous ICCV 2021
Regarding the paper topic, the official also released relevant data: multi-view and sensor 3D technology is the most popular
In today’s opening ceremony, the most important part is to announce the award-winning information. Now, let us reveal the Best Paper, Best Paper Nomination and Best Student Paper one by one
Best Paper - Marr Award
Total Two papers won this year's best paper (Marr Prize).
The first article comes from researchers at the University of Toronto.
- Paper address: https://openaccess.thecvf.com/content/ICCV2023/ papers/Wei_Passive_Ultra-Wideband_Single-Photon_Imaging_ICCV_2023_paper.pdf
- Authors: Mian Wei, Sotiris Nousias, Rahul Gulve, David B. Lindell, Kiriakos N. Kutulakos
- Institution: University of Toronto
Abstract: This paper considers the problem of imaging dynamic scenes simultaneously at extreme time scales (seconds to picoseconds), and Imaging is done passively, without much light and without any timing signals from the light source that emits it. Since existing flux estimation techniques for single-photon cameras fail in this case, we develop a flux detection theory that draws insights from stochastic calculus to enable the Time-varying flux of reconstructed pixels in a stream of photon detection timestamps.
This paper uses this theory to show that passive free-running SPAD cameras have an achievable frequency bandwidth under low-flux conditions that spans the entire DC to 31 GHz range. At the same time, this paper also derives a novel Fourier domain flux reconstruction algorithm and ensures that the noise model of this algorithm is still effective under very low photon counts or non-negligible dead time
The potential of this asynchronous imaging mechanism is experimentally demonstrated: (1) No synchronization is required for imaging scenes illuminated simultaneously by light sources (such as light bulbs, projectors, multiple pulsed lasers) operating at different speeds; (2) Achieve passive non-line-of-sight video collection; (3) Record ultra-wideband video and later play it back at 30 Hz to show daily movement, or play it back a billion times slower to show the propagation of light itself
#The second article is what we know as ControNet.
- ##Paper address: https://arxiv.org/pdf/2302.05543.pdf
- Authors: Lvmin Zhang, Anyi Rao, Maneesh Agrawala
- Institution: Stanford University
Abstract: This study proposes a An end-to-end neural network architecture called ControlNet. This architecture improves image generation by adding additional conditions to control the diffusion model (such as stable diffusion). At the same time, ControlNet can generate full-color images from line drawings, generate images with the same depth structure, and optimize hand generation effects through hand key points.
The core idea of ControlNet is to add some additional conditions to the text description to control the diffusion model (such as Stable Diffusion), thereby better controlling the character pose, depth, picture structure and other information of the generated image.
The additional conditions here are input in the form of an image. The model can perform Canny edge detection, depth detection, semantic segmentation, Hough transform line detection, and overall nesting based on this input image. edge detection (HED), human pose recognition, etc., and then retain this information in the generated image. Using this model, we can directly convert line drawings or graffiti into full-color images, generate images with the same depth structure, etc., and optimize the generation of character hands through hand key points.
Please refer to Heart of the Machine's report "AI dimensionality reduction hits human painters, Vincentian graphs are introduced into ControlNet, and depth and edge information are fully reused" to Get a more detailed introduction
Best paper nomination: SAM
In April of this year, Meta released a paper called "Separate Everything (SAM) ” artificial intelligence model, which can generate masks for objects in any image or video, which shocked researchers in the field of computer vision. Some even said that “computer vision no longer exists”
Now, this high-profile paper is nominated for the best paper.
- ##Paper address: https://arxiv.org/abs/2304.02643
- Organization: Meta AI
Rewritten content: Before solving the segmentation problem, there are usually two methods. The first is interactive segmentation, which can be used to segment any class of objects but requires a human to guide the method by iteratively refining the mask. The second is automatic segmentation, which can be used to segment predefined specific object categories (such as cats or chairs), but requires a large number of manually annotated objects for training (such as thousands or even tens of thousands of examples of segmented cats). However, neither of these two methods provides a universal, fully automatic segmentation method
The SAM proposed by Meta nicely generalizes these two methods. It is a single model that can easily perform interactive segmentation and automatic segmentation. The model's promptable interface allows users to use it in a flexible way, enabling a wide range of segmentation tasks to be accomplished simply by designing the right prompts (clicks, box selections, text, etc.) for the model
To summarize, these features enable SAM to adapt to new tasks and domains. This flexibility is unique in the field of image segmentation
For details, please refer to the Heart of the Machine report: "CV Doesn't Exist?" Meta releases “split everything” AI model, CV may usher in GPT-3 moment》
Best Student Paper
The research was conducted by It was jointly completed by researchers from Cornell University, Google Research and UC Berkeley. The first work was Qianqian Wang, a doctoral student from Cornell Tech. They jointly proposed OmniMotion, a complete and globally consistent motion representation, and proposed a new test-time optimization method to perform accurate and complete motion estimation for every pixel in the video.
- ##Paper address: https://arxiv.org/abs/2306.05422
- Project homepage: https://omnimotion.github.io/
The OmniMotion proposed in this research uses a quasi-3D canonical volume to characterize the video and tracks each pixel through a bijection between local space and canonical space. This representation enables global consistency, enables motion tracking even when objects are occluded, and models any combination of camera and object motion. This study experimentally demonstrates that the proposed method significantly outperforms existing SOTA methods.
Please refer to the Heart of Machine report "The "track everything" video algorithm that tracks every pixel anytime, anywhere, and is not afraid of occlusion is here" for a more detailed introduction In addition to these award-winning papers, this year’s ICCV also has many other outstanding papers worthy of everyone’s attention. The following is an initial list of the 17 winning papers
The above is the detailed content of ICCV 2023 announced the winners of popular papers such as ControlNet and 'Split Everything'. For more information, please follow other related articles on the PHP Chinese website!

In John Rawls' seminal 1971 book The Theory of Justice, he proposed a thought experiment that we should take as the core of today's AI design and use decision-making: the veil of ignorance. This philosophy provides a simple tool for understanding equity and also provides a blueprint for leaders to use this understanding to design and implement AI equitably. Imagine that you are making rules for a new society. But there is a premise: you don’t know in advance what role you will play in this society. You may end up being rich or poor, healthy or disabled, belonging to a majority or marginal minority. Operating under this "veil of ignorance" prevents rule makers from making decisions that benefit themselves. On the contrary, people will be more motivated to formulate public

Numerous companies specialize in robotic process automation (RPA), offering bots to automate repetitive tasks—UiPath, Automation Anywhere, Blue Prism, and others. Meanwhile, process mining, orchestration, and intelligent document processing speciali

The future of AI is moving beyond simple word prediction and conversational simulation; AI agents are emerging, capable of independent action and task completion. This shift is already evident in tools like Anthropic's Claude. AI Agents: Research a

Rapid technological advancements necessitate a forward-looking perspective on the future of work. What happens when AI transcends mere productivity enhancement and begins shaping our societal structures? Topher McDougal's upcoming book, Gaia Wakes:

Product classification, often involving complex codes like "HS 8471.30" from systems such as the Harmonized System (HS), is crucial for international trade and domestic sales. These codes ensure correct tax application, impacting every inv

The future of energy consumption in data centers and climate technology investment This article explores the surge in energy consumption in AI-driven data centers and its impact on climate change, and analyzes innovative solutions and policy recommendations to address this challenge. Challenges of energy demand: Large and ultra-large-scale data centers consume huge power, comparable to the sum of hundreds of thousands of ordinary North American families, and emerging AI ultra-large-scale centers consume dozens of times more power than this. In the first eight months of 2024, Microsoft, Meta, Google and Amazon have invested approximately US$125 billion in the construction and operation of AI data centers (JP Morgan, 2024) (Table 1). Growing energy demand is both a challenge and an opportunity. According to Canary Media, the looming electricity

Generative AI is revolutionizing film and television production. Luma's Ray 2 model, as well as Runway's Gen-4, OpenAI's Sora, Google's Veo and other new models, are improving the quality of generated videos at an unprecedented speed. These models can easily create complex special effects and realistic scenes, even short video clips and camera-perceived motion effects have been achieved. While the manipulation and consistency of these tools still need to be improved, the speed of progress is amazing. Generative video is becoming an independent medium. Some models are good at animation production, while others are good at live-action images. It is worth noting that Adobe's Firefly and Moonvalley's Ma

ChatGPT user experience declines: is it a model degradation or user expectations? Recently, a large number of ChatGPT paid users have complained about their performance degradation, which has attracted widespread attention. Users reported slower responses to models, shorter answers, lack of help, and even more hallucinations. Some users expressed dissatisfaction on social media, pointing out that ChatGPT has become “too flattering” and tends to verify user views rather than provide critical feedback. This not only affects the user experience, but also brings actual losses to corporate customers, such as reduced productivity and waste of computing resources. Evidence of performance degradation Many users have reported significant degradation in ChatGPT performance, especially in older models such as GPT-4 (which will soon be discontinued from service at the end of this month). this


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

SublimeText3 Linux new version
SublimeText3 Linux latest version

SecLists
SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.

SublimeText3 Chinese version
Chinese version, very easy to use

VSCode Windows 64-bit Download
A free and powerful IDE editor launched by Microsoft

PhpStorm Mac version
The latest (2018.2.1) professional PHP integrated development tool
