HTML5: Use Canvas to process Video in real time-H5 Tutorial-php.cn

Home

Web Front-end

H5 Tutorial

HTML5: Use Canvas to process Video in real time

高洛峰

May 28, 2018 pm 05:58 PM

htmlhtml5

Document content

The XHTML document used in this article is as follows.

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<style>
body {
background: black;
color:#CCCCCC;
}
#c2 {
background-image: url(foo.png);
background-repeat: no-repeat;
}
p {
float: left;
border :1px solid #444444;
padding:10px;
margin: 10px;
background:#3B3B3B;
}
</style>
<script type="text/javascript;version=1.8" src="main.js"></script>
</head>

<body onload="processor.doLoad()">
<p>
<video id="video" src="video.ogv" controls="true"/>
</p>
<p>
<canvas id="c1" width="160" height="96"/>
<canvas id="c2" width="160" height="96"/>
</p>
</body>
</html>

The key parts of the above code are as follows:

1. Create two canvas elements with IDs c1 and c2 respectively. c1 is used to display the original video of the current frame, c2 is used to display the video after performing chroma-keying special effects; c2 is preloaded with a static image, which will be used to replace the background color part of the video.

2. The JavaScript code is imported from the main.js file; this script uses the features of JavaScript 1.8, so when importing the script, the version is specified in line 22.

3. When the web page is loaded, the processor.doLoad() method in main.js will run.

JavaScript code

The JS code in main.js contains three methods.

Initialize chroma-key

The doLoad() method is called when the XHTML document is initially loaded. The purpose of this method is to prepare the required variables for the chroma-key processing code and set up an event listener so that we can detect when the user starts playing the video.

doLoad: function() {
this.video = document.getElementById("video");
this.c1 = document.getElementById("c1");
this.ctx1 = this.c1.getContext("2d");
this.c2 = document.getElementById("c2");
this.ctx2 = this.c2.getContext("2d");
let self = this;
this.video.addEventListener("play", function() {
self.width = self.video.videoWidth / 2;
self.height = self.video.videoHeight / 2;
self.timerCallback();
}, false);
},

This code obtains references to the video element and two canvas elements in the XHTML document, and also obtains references to the graphics context of the two canvases. These will be used when we implement the chroma-keying effect.

addEventListener() listens to the video element and is called when the user presses the play button on the video. In order to handle user playback, this code takes the width and height of the video, halves it (we will halve the size of the video when performing the chroma-keying effect), and then calls the timerCallback() method to initiate video capture and visual effects calculations .

Timer callback

The timer callback function is called when the video starts playing (when the "play" event occurs), and is then responsible for its own periodic call to implement keying special effects for each frame of video. .

timerCallback: function() {
if (this.video.paused || this.video.ended) {
return;
}
this.computeFrame();
let self = this;
setTimeout(function () {
self.timerCallback();
}, 0);
},

The callback function first checks whether the video is playing; if not, the callback function does nothing and returns immediately.

Then call the computeFrame() method, which performs chroma-keying special effects on the current video frame.

The last thing the callback function does is call setTimeout() to allow it to be re-called as soon as possible. In a real environment, you might set the call frequency based on the frame rate of the video.

Processing video frame data

The computeFrame() method, as shown below, is actually responsible for grabbing the data of each frame and executing chroma-keying special effects.

computeFrame: function() {
this.ctx1.drawImage(this.video, 0, 0, this.width, this.height);
let frame = this.ctx1.getImageData(0, 0, this.width, this.height);
let l = frame.data.length / 4;

for (let i = 0; i < l; i++) {
let r = frame.data[i * 4 + 0];
let g = frame.data[i * 4 + 1];
let b = frame.data[i * 4 + 2];
if (g > 100 && r > 100 && b < 43)
frame.data[i * 4 + 3] = 0;
}
this.ctx2.putImageData(frame, 0, 0);
return;
}

When it is called, the video element will display the most recent video frame data as follows:

HTML5: Use Canvas to process Video in real time

In line 2, the video frame is Copied into the graphics context of the first canvas ctx1, specify the height and width values as half the frame size we saved earlier. Note that you can draw the current video frame by passing the video element to the drawImage() method of the drawing context. The result is:

HTML5: Use Canvas to process Video in real time

The third line of code obtains a copy of the original image data of the current video frame by calling the getImageData() method of the first canvas context. It provides raw 32-bit pixel image data so we can manipulate it. Line 4 of code calculates the total number of pixels in the image by dividing the total length of the frame image data by 4.

Line 6 of code scans all pixels in a loop, obtains the red, green, and blue values of each pixel, and compares it with the predefined background color. These background colors will use the background image imported in foo.png replace.

For each pixel that is detected as background, its alpha value is replaced with zero, indicating that the pixel is completely transparent. As a result, the background portion of the final image is 100% transparent, so that when it is drawn into the context of the target on line 13, the effect is that the content is superimposed on the static background.

The resulting image looks like this:

HTML5: Use Canvas to process Video in real time

# Do this repeatedly while the video plays, so that frame by frame is processed, rendering the chroma -Key special effects.

For more HTML5: Using Canvas to process Video in real time, please pay attention to the PHP Chinese website!

Statement

The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

What is the H5 tag in HTML?May 09, 2025 am 12:11 AM

The H5 tag in HTML is a fifth-level title that is used to tag smaller titles or sub-titles. 1) The H5 tag helps refine content hierarchy and improve readability and SEO. 2) Combined with CSS, you can customize the style to enhance the visual effect. 3) Use H5 tags reasonably to avoid abuse and ensure the logical content structure.

H5 Code: A Beginner's Guide to Web StructureMay 08, 2025 am 12:15 AM

The methods of building a website in HTML5 include: 1. Use semantic tags to define the web page structure, such as, , etc.; 2. Embed multimedia content, use and tags; 3. Apply advanced functions such as form verification and local storage. Through these steps, you can create a modern web page with clear structure and rich features.

H5 Code Structure: Organizing Content for ReadabilityMay 07, 2025 am 12:06 AM

A reasonable H5 code structure allows the page to stand out among a lot of content. 1) Use semantic labels such as, etc. to organize content to make the structure clear. 2) Control the rendering effect of pages on different devices through CSS layout such as Flexbox or Grid. 3) Implement responsive design to ensure that the page adapts to different screen sizes.

H5 vs. Older HTML Versions: A ComparisonMay 06, 2025 am 12:09 AM

The main differences between HTML5 (H5) and older versions of HTML include: 1) H5 introduces semantic tags, 2) supports multimedia content, and 3) provides offline storage functions. H5 enhances the functionality and expressiveness of web pages through new tags and APIs, such as and tags, improving user experience and SEO effects, but need to pay attention to compatibility issues.

H5 vs. HTML5: Clarifying the Terminology and RelationshipMay 05, 2025 am 12:02 AM

The difference between H5 and HTML5 is: 1) HTML5 is a web page standard that defines structure and content; 2) H5 is a mobile web application based on HTML5, suitable for rapid development and marketing.

HTML5 Features: The Core of H5May 04, 2025 am 12:05 AM

The core features of HTML5 include semantic tags, multimedia support, form enhancement, offline storage and local storage. 1. Semantic tags such as, improve code readability and SEO effect. 2. Multimedia support simplifies the process of embedding media content through and tags. 3. Form Enhancement introduces new input types and verification properties, simplifying form development. 4. Offline storage and local storage improve web page performance and user experience through ApplicationCache and localStorage.

H5: Exploring the Latest Version of HTMLMay 03, 2025 am 12:14 AM

HTML5isamajorrevisionoftheHTMLstandardthatrevolutionizeswebdevelopmentbyintroducingnewsemanticelementsandcapabilities.1)ItenhancescodereadabilityandSEOwithelementslike,,,and.2)HTML5enablesricher,interactiveexperienceswithoutplugins,allowingdirectembe

Beyond Basics: Advanced Techniques in H5 CodeMay 02, 2025 am 12:03 AM

Advanced tips for H5 include: 1. Use complex graphics to draw, 2. Use WebWorkers to improve performance, 3. Enhance user experience through WebStorage, 4. Implement responsive design, 5. Use WebRTC to achieve real-time communication, 6. Perform performance optimization and best practices. These tips help developers build more dynamic, interactive and efficient web applications.

See all articles