Vision Pro function decentralization? iPhone, iPad and other devices may support air gestures

According to the recently announced World Intellectual Property Office (WIPO) list, Apple has recently obtained a gesture recognition patent called "GESTURE RECOGNITION WITH HAND-OBJECT INTERACTION". This news hints that the various air gesture control technologies now available for the Vision Pro headset may be extended to other devices such as iPhones, iPads, and MacBooks.

The key to this patented technology is to enable the device to scan and recognize the user's gestures and analyze the data to identify specific gestures. For example, a camera can take an image of the user's arm, or an accelerometer on the hand can record hand movement information. By analyzing the captured gesture data and comparing it with predefined gestures, the device can implement corresponding interactive operations.

Figure 1 shows an example scenario 100 of gesture recognition. In this scenario, the device 102 is equipped with a sensor 104 for scanning the subject user's body part 120 and another object 122 within the close range area 110 . The sensor realizes the recognition and understanding of the user's intention by capturing the user's gestures and movements. This technology can help devices better interact with users and provide a smarter user experience. By analyzing the data obtained by the sensor, the device can recognize different gestures, such as waving, nodding or other gestures, and perform corresponding actions or point at certain In one aspect, object 122 may be any object in close range area 110 except body part 120 .

For example, body part 120 could be a hand, and object 122 could be a pen or another hand. Body part 120 and other objects 122 may interact while scanning close range area 110; for example, body part 120 and object 122 may interact such that one obscures the other.

In example scenario 100 , a portion of body part 120 may be occluded by object 122 along an occlusion direction 124 away from sensor 104 .

In different scenarios not depicted in Figure 1, different interactions may include object 122 being occluded by a portion of body part 120. In one aspect, gestures may be performed by body parts and the gesture recognition process may be controlled by interactions between body parts 120 and objects 122 detected in the scan.

Editor’s comment: The approval of this patent brings a more flexible and intuitive interaction method to Apple’s devices, not only It's Vision Pro. In the future, users may enjoy a more intelligent gesture control experience on devices such as iPhone, iPad and MacBook.

The above is the detailed content of Vision Pro function decentralization? iPhone, iPad and other devices may support air gestures. For more information, please follow other related articles on the PHP Chinese website!