Deep dive into Emoji encoding: from Unicode to UTF-8 bytes
Have you tried converting a string containing Emoji to bytes?
text = 'Hi ??♂️' print(bytes(text, 'utf-8'))
Output result:
<code>b'Hi \xf0\x9f\x99\x8b\xf0\x9f\x8f\xbd\xe2\x80\x8d\xe2\x99\x82\xef\xb8\x8f'</code>
Are you curious what those x
are and how they convert back to Emoji?
Digging deeper, you will find that a single Emoji requires five Unicode characters to represent.
emoji = '??♂️' print("Length: ", len(emoji)) for c in emoji: code = ord(c) print("{}\t{}\t{}".format(code, hex(code), c))
Output result:
<code>Length: 5 128587 0x1f64b ? 127997 0x1f3fd ? 8205 0x200d 9794 0x2642 ♂ 65039 0xfe0f ️</code>
First, we have the basic emoji: Person with hands raised? (128587 or 0x1f64b in hexadecimal), usually represented as U 1F64B.
Then there’s the skin tone modifier: Light Skin Tone (127997).
Combine these two and you get a gender neutral raised hand person with this skin tone.
print(chr(128587) + chr(127997))
Output result:
<code>??</code>
The penultimate character represents the male symbol, and the last character is called Variant Selector-16 (VS16), which indicates that the previous character should be displayed as an emoji, not a symbol.
Many characters can be displayed as symbols or emojis.
heart_symbol= '♥' print(heart_symbol) print(heart_symbol + chr(65039))
Output result:
<code>♥ ♥️</code>
Note: If the system or renderer does not support the emoji, it may be rendered as a symbol. In this case, copy the output and paste it into a different text editor or browser to see the differences.
Therefore, the first two and last two characters represent two separate Emoji expressions. The middle character is called a zero-width joiner (ZWJ) and is used to combine two or more emoji.
woman = '?' laptop = '?' print(woman + chr(8205) + laptop)
Output result:
<code>??</code>
Of course, the system or font must support these combinations, otherwise it will just render as separate characters.
man = '?' toilet = '?' print(man + chr(8205) + toilet)
Output result:
<code>??</code>
Now let’s see how each Unicode character is represented as bytes in UTF-8 encoding in general.
Let us consider the character U 1F64B.
First, we have to determine how many bytes are needed to store it based on the range of the character. We could store the number itself in just three bytes, but then there would be no way to decode it back to a single character. Therefore, the following pattern is used: (Why use this pattern?)
11110xxx 10xxxxxx 10xxxxxx 10xxxxxx
Now let’s put the bits of the number 0x1f64b into this pattern. First convert it to binary.
print(bin(0x1F64B))
Output result:
<code>0b11111011001001011</code>
The pattern has 21 bits, so let’s add 0 at the beginning to match:
000011111011001001011
000 011111 011001 001011
Put into pattern: 11110000 10011111 10011001 10001011
Now, what is the hexadecimal representation of these bytes?
print(list(map(hex, [0b11110000, 0b10011111, 0b10011001, 0b10001011])))
Output result:
<code>['0xf0', '0x9f', '0x99', '0x8b']</code>
Note that these match the first four x
we want to understand. Now you know what they mean.
Related notes: https://www.php.cn/link/0da44af358e8fcb6a6c2040602172d8d
The above is the detailed content of Exploring emoji encodings. For more information, please follow other related articles on the PHP Chinese website!

Create multi-dimensional arrays with NumPy can be achieved through the following steps: 1) Use the numpy.array() function to create an array, such as np.array([[1,2,3],[4,5,6]]) to create a 2D array; 2) Use np.zeros(), np.ones(), np.random.random() and other functions to create an array filled with specific values; 3) Understand the shape and size properties of the array to ensure that the length of the sub-array is consistent and avoid errors; 4) Use the np.reshape() function to change the shape of the array; 5) Pay attention to memory usage to ensure that the code is clear and efficient.

BroadcastinginNumPyisamethodtoperformoperationsonarraysofdifferentshapesbyautomaticallyaligningthem.Itsimplifiescode,enhancesreadability,andboostsperformance.Here'showitworks:1)Smallerarraysarepaddedwithonestomatchdimensions.2)Compatibledimensionsare

ForPythondatastorage,chooselistsforflexibilitywithmixeddatatypes,array.arrayformemory-efficienthomogeneousnumericaldata,andNumPyarraysforadvancednumericalcomputing.Listsareversatilebutlessefficientforlargenumericaldatasets;array.arrayoffersamiddlegro

Pythonlistsarebetterthanarraysformanagingdiversedatatypes.1)Listscanholdelementsofdifferenttypes,2)theyaredynamic,allowingeasyadditionsandremovals,3)theyofferintuitiveoperationslikeslicing,but4)theyarelessmemory-efficientandslowerforlargedatasets.

ToaccesselementsinaPythonarray,useindexing:my_array[2]accessesthethirdelement,returning3.Pythonuseszero-basedindexing.1)Usepositiveandnegativeindexing:my_list[0]forthefirstelement,my_list[-1]forthelast.2)Useslicingforarange:my_list[1:5]extractselemen

Article discusses impossibility of tuple comprehension in Python due to syntax ambiguity. Alternatives like using tuple() with generator expressions are suggested for creating tuples efficiently.(159 characters)

The article explains modules and packages in Python, their differences, and usage. Modules are single files, while packages are directories with an __init__.py file, organizing related modules hierarchically.

Article discusses docstrings in Python, their usage, and benefits. Main issue: importance of docstrings for code documentation and accessibility.


Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

VSCode Windows 64-bit Download
A free and powerful IDE editor launched by Microsoft

SublimeText3 English version
Recommended: Win version, supports code prompts!

DVWA
Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

SublimeText3 Chinese version
Chinese version, very easy to use

SecLists
SecLists is the ultimate security tester's companion. It is a collection of various types of lists that are frequently used during security assessments, all in one place. SecLists helps make security testing more efficient and productive by conveniently providing all the lists a security tester might need. List types include usernames, passwords, URLs, fuzzing payloads, sensitive data patterns, web shells, and more. The tester can simply pull this repository onto a new test machine and he will have access to every type of list he needs.
