search
HomeTechnology peripheralsAITouch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

The development of electronic technology allows us to enjoy an "audio-visual feast" anytime and anywhere, and human hearing and vision have been completely liberated.

#In recent years, adding "haptics" to devices has gradually become a new research hotspot, especially with the blessing of the concept of "metaverse". The high sense of touch will undoubtedly greatly enhance the realism of the virtual world.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

Current tactile sensing technology mainly simulates and renders touch through a "data-driven" model. The model first records the user's interaction with the real texture. The signal is then input to the texture generation part, and the touch sensation is "played back" to the user in the form of vibration.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

# Some recent methods are mostly based on user interactive motion and high-frequency vibration signals to model texture features, such as friction and microscopic surface features.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

Although data-driven greatly improves the realism of simulation, there are still many limitations.

#For example, there are "countless types" of textures in the world. If each texture was recorded, the manpower and material resources required would be unimaginable. It also cannot meet the needs of some niche users.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

Human beings are very sensitive to touch. Different people have different feelings for the same object. The data-driven approach cannot fundamentally eliminate the problem of touch. Texture recording to texture rendering perceptual mismatch issue.

Recently, three doctoral students at the University of Southern California Viterbi School of Engineering proposed a new "preference-driven" model framework that uses humans to resolve texture details. The ability to adjust the generated virtual perception can ultimately achieve quite realistic tactile perception. The paper was published in IEEE Transactions on Haptics.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

Paper link : https://ieeexplore.ieee.org/document/9772285

The preference-driven model will first give the user a realistic touch texture, and then the model will use Dozens of variables randomly generate three virtual textures, from which the user can then choose the one that feels most similar to the real object.

With continuous trial and error and feedback, the model will continuously optimize the distribution of variables through search, making the generated texture closer to the user's preference. This method has significant advantages over directly recording and playing back textures, as there is always a gap between what the computer reads and how humans actually feel.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

This process is actually similar to "Party A and Party B". As the perceiver (Party A), if we feel that the touch feels wrong, we will Go back and let the algorithm (Party B) modify and regenerate until the generated effect is satisfactory.

This is actually very reasonable, because different people will have different feelings when touching the same object, but the signal released by the computer is the same, so It is necessary to customize the touch according to each person!

The entire system consists of two modules. The first is a deep convolutional generative adversarial network (DCGAN), which is used to map the vectors of the latent space to the texture model. In the UPenn Haptic Texture Toolkit (HaTT) for training.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

The second module is a comparison-based evolutionary algorithm: from a set of generated texture models, the covariance matrix adaptive evolution strategy (CMA-ES) will create a new texture model based on user preference feedback. evolution.

To simulate real textures, the researchers first ask users to touch real textures using custom tools, and then use a haptic device to touch a set of virtual texture candidates, where haptic Feedback is transmitted via Haptuator connected to the device's stylus.

The only thing the user needs to do is to select the virtual texture that is closest to the real texture and use a simple slider interface to adjust the amount of friction. Because friction is critical to texture feel, it can also vary from person to person.

Then all virtual textures will be updated according to the evolution strategy according to the user's selection, and then the user will select and adjust again.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

Repeat the above process until the user finds a virtual texture that they believe is close to the real texture and saves it, or a closer virtual texture cannot be found .

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

The researchers divided the evaluation process into two phases, each with a separate group of participants.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

#In the first stage, five participants generated and searched virtual textures for 5 real textures respectively.

The second stage is to evaluate the gap between the final saved preference-driven texture (VTp) and its corresponding real texture (RT).

The evaluation method mainly uses adjective rating to evaluate perceptual dimensions including roughness, hardness and smoothness.

#And compare the similarities between VTp, RT and data-driven textures (VTd).

#The experimental results also show that following the evolutionary process, users can effectively find a virtual texture model that is more realistic than the data-driven model.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

In addition, more than 80% of participants believed that the virtual texture ratings generated by the preference-driven model were better than those generated by the data-driven model.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

Haptic devices are becoming more and more popular in video games, fashion design, and surgical simulations, and even at home, we are starting to see users using Laptops are as popular as those tactile devices.

#For example, adding touch to first-person video games will greatly enhance the player’s sense of reality.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

The author of the paper stated that when we interact with the environment through tools, tactile feedback is just one form, one kind of sensory feedback, and audio is another sensory feedback, both are very important.

#In addition to games, the results of this work will be particularly useful for virtual textures used in dental or surgical training, which need to be very accurate.

"Surgical training is absolutely a huge field that requires very realistic textures and tactile feedback; decoration design also requires a high degree of precision in texture during development Simulate it on the ground and then manufacture it."

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

Everything from video games to fashion design is integrating haptic technology, and existing virtual texture databases can be improved with this user-preference approach.

Texture search models also allow users to extract virtual textures from databases, such as the University of Pennsylvania's Tactile Texture Toolkit, which can be refined until they are obtained desired result.

#Once this technology is combined with the texture search model, you can use virtual textures that have been recorded by others before, and then optimize the textures based on strategies.

#The author imagines that in the future, models may not even need real textures.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

The sense of some common things in our lives is very intuitive, and we are hard-wired to fine-tune our senses by looking at photos without having to Reference to real textures.

For example, when we see a table, we can imagine how it will feel once we touch the table, using our prior knowledge of the surface. With experience knowledge, you can provide visual feedback to users and allow them to select matching content.

The first author of the article, Shihan Lu, is currently a doctoral candidate at the School of Computer Science at the University of Southern California. He has previously done sound-related work in immersive technology. , which makes virtual textures more immersive by introducing matching sounds when tools interact with them.

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm

The second author of the article, Mianlun Zheng (Zheng Mianlun), is a doctoral candidate in the School of Computer Science at the University of Southern California. He graduated from Wuhan University with bachelor's and master's degrees. .

Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the tactile perception algorithm ##​

The above is the detailed content of Touch has never been so real! Two Chinese Ph.D.s from the University of Southern California innovate the 'tactile perception' algorithm. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:51CTO.COM. If there is any infringement, please contact admin@php.cn delete
特斯拉自动驾驶算法和模型解读特斯拉自动驾驶算法和模型解读Apr 11, 2023 pm 12:04 PM

特斯拉是一个典型的AI公司,过去一年训练了75000个神经网络,意味着每8分钟就要出一个新的模型,共有281个模型用到了特斯拉的车上。接下来我们分几个方面来解读特斯拉FSD的算法和模型进展。01 感知 Occupancy Network特斯拉今年在感知方面的一个重点技术是Occupancy Network (占据网络)。研究机器人技术的同学肯定对occupancy grid不会陌生,occupancy表示空间中每个3D体素(voxel)是否被占据,可以是0/1二元表示,也可以是[0, 1]之间的

基于因果森林算法的决策定位应用基于因果森林算法的决策定位应用Apr 08, 2023 am 11:21 AM

译者 | 朱先忠​审校 | 孙淑娟​在我之前的​​博客​​中,我们已经了解了如何使用因果树来评估政策的异质处理效应。如果你还没有阅读过,我建议你在阅读本文前先读一遍,因为我们在本文中认为你已经了解了此文中的部分与本文相关的内容。为什么是异质处理效应(HTE:heterogenous treatment effects)呢?首先,对异质处理效应的估计允许我们根据它们的预期结果(疾病、公司收入、客户满意度等)选择提供处理(药物、广告、产品等)的用户(患者、用户、客户等)。换句话说,估计HTE有助于我

因果推断主要技术思想与方法总结因果推断主要技术思想与方法总结Apr 12, 2023 am 08:10 AM

导读:因果推断是数据科学的一个重要分支,在互联网和工业界的产品迭代、算法和激励策略的评估中都扮演者重要的角色,结合数据、实验或者统计计量模型来计算新的改变带来的收益,是决策制定的基础。然而,因果推断并不是一件简单的事情。首先,在日常生活中,人们常常把相关和因果混为一谈。相关往往代表着两个变量具有同时增长或者降低的趋势,但是因果意味着我们想要知道对一个变量施加改变的时候会发生什么样的结果,或者说我们期望得到反事实的结果,如果过去做了不一样的动作,未来是否会发生改变?然而难点在于,反事实的数据往往是

Mango:基于Python环境的贝叶斯优化新方法Mango:基于Python环境的贝叶斯优化新方法Apr 08, 2023 pm 12:44 PM

译者 | 朱先忠审校 | 孙淑娟引言模型超参数(或模型设置)的优化可能是训练机器学习算法中最重要的一步,因为它可以找到最小化模型损失函数的最佳参数。这一步对于构建不易过拟合的泛化模型也是必不可少的。优化模型超参数的最著名技术是穷举网格搜索和随机网格搜索。在第一种方法中,搜索空间被定义为跨越每个模型超参数的域的网格。通过在网格的每个点上训练模型来获得最优超参数。尽管网格搜索非常容易实现,但它在计算上变得昂贵,尤其是当要优化的变量数量很大时。另一方面,随机网格搜索是一种更快的优化方法,可以提供更好的

使用Pytorch实现对比学习SimCLR 进行自监督预训练使用Pytorch实现对比学习SimCLR 进行自监督预训练Apr 10, 2023 pm 02:11 PM

SimCLR(Simple Framework for Contrastive Learning of Representations)是一种学习图像表示的自监督技术。 与传统的监督学习方法不同,SimCLR 不依赖标记数据来学习有用的表示。 它利用对比学习框架来学习一组有用的特征,这些特征可以从未标记的图像中捕获高级语义信息。SimCLR 已被证明在各种图像分类基准上优于最先进的无监督学习方法。 并且它学习到的表示可以很容易地转移到下游任务,例如对象检测、语义分割和小样本学习,只需在较小的标记

​盒马供应链算法实战​盒马供应链算法实战Apr 10, 2023 pm 09:11 PM

一、盒马供应链介绍1、盒马商业模式盒马是一个技术创新的公司,更是一个消费驱动的公司,回归消费者价值:买的到、买的好、买的方便、买的放心、买的开心。盒马包含盒马鲜生、X 会员店、盒马超云、盒马邻里等多种业务模式,其中最核心的商业模式是线上线下一体化,最快 30 分钟到家的 O2O(即盒马鲜生)模式。2、盒马经营品类介绍盒马精选全球品质商品,追求极致新鲜;结合品类特点和消费者购物体验预期,为不同品类选择最为高效的经营模式。盒马生鲜的销售占比达 60%~70%,是最核心的品类,该品类的特点是用户预期时

人类反超 AI:DeepMind 用 AI 打破矩阵乘法计算速度 50 年记录一周后,数学家再次刷新人类反超 AI:DeepMind 用 AI 打破矩阵乘法计算速度 50 年记录一周后,数学家再次刷新Apr 11, 2023 pm 01:16 PM

10 月 5 日,AlphaTensor 横空出世,DeepMind 宣布其解决了数学领域 50 年来一个悬而未决的数学算法问题,即矩阵乘法。AlphaTensor 成为首个用于为矩阵乘法等数学问题发现新颖、高效且可证明正确的算法的 AI 系统。论文《Discovering faster matrix multiplication algorithms with reinforcement learning》也登上了 Nature 封面。然而,AlphaTensor 的记录仅保持了一周,便被人类

研究表明强化学习模型容易受到成员推理攻击研究表明强化学习模型容易受到成员推理攻击Apr 09, 2023 pm 08:01 PM

​译者 | 李睿 审校 | 孙淑娟​随着机器学习成为人们每天都在使用的很多应用程序的一部分,人们越来越关注如何识别和解决机器学习模型的安全和隐私方面的威胁。 然而,不同机器学习范式面临的安全威胁各不相同,机器学习安全的某些领域仍未得到充分研究。尤其是强化学习算法的安全性近年来并未受到太多关注。 加拿大的麦吉尔大学、机器学习实验室(MILA)和滑铁卢大学的研究人员开展了一项新研究,主要侧重于深度强化学习算法的隐私威胁。研究人员提出了一个框架,用于测试强化学习模型对成员推理攻击的脆弱性。 研究

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Tools

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

SublimeText3 English version

SublimeText3 English version

Recommended: Win version, supports code prompts!