search
HomeBackend DevelopmentPython TutorialThe secret recipe of Python's logging module: building an efficient logging system

Python logging 模块的秘密配方:打造高效日志系统

python The logging module is a powerful and versatile tool that can be used for logging in Python applications and admin log messages. By mastering the secret recipe of the logging module, you can create an efficient and easy-to-maintain logging system that improves the reliability and debuggability of your application.

Custom log level

The logging module provides a set of predefined log levels, including DEBUG, INFO, WARNING, ERROR, and CRITICAL. You can customize these levels to create a more granular logging hierarchy based on your application's needs. For example, you can add a custom level, such as "TRACE", to log detailed events that occur in your application.

import logging

# 创建自定义日志级别
TRACE = logging.DEBUG - 5
logging.addLevelName(TRACE, "TRACE")

# 创建一个使用自定义级别的日志记录器
logger = logging.getLogger(__name__)
logger.setLevel(TRACE)

Use multiple log handlers

The log handler is responsible for sending log messages to different destinations, such as a file, the console, or a remote server . The logging module provides a range of built-in handlers, and you can create custom handlers to meet your specific needs. Using multiple handlers, you can log messages to multiple targets simultaneously, providing more comprehensive logging.

# 创建一个文件处理程序
file_handler = logging.FileHandler("my_log.log")

# 创建一个控制台处理程序
console_handler = logging.StreamHandler()

# 为日志记录器添加处理程序
logger.addHandler(file_handler)
logger.addHandler(console_handler)

Log format

The log format specifies the structure and layout of the log message. The logging module provides a flexible formatting system that allows you to customize the appearance of log messages. Using the log format, you can include information such as message content, timestamp, log level, and calling code source.

# 创建一个自定义日志格式
fORMatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s")

# 将格式应用于处理程序
file_handler.setFormatter(formatter)
console_handler.setFormatter(formatter)

Filter log messages

The logging module allows you to filter log messages and only log messages that match certain criteria. Filters can be created based on log level, message content, or other custom criteria. Filtering log messages can reduce log output and ensure that only messages useful for debugging or analysis are logged.

# 创建一个过滤器以只记录 ERROR 和 CRITICAL 消息
filter = logging.Filter()
filter.filter = lambda record: record.levelno >= logging.ERROR

# 将过滤器应用于一个处理程序
file_handler.addFilter(filter)

Log propagation

Log propagation controls how log messages are propagated. By default, log messages are propagated to all loggers in the application that contain handlers. However, you can control the flow of messages through the logger hierarchy by configuring log propagation. This helps prevent duplicate and redundant log messages.

# 禁用日志传播
logger.propagate = False

Log rotation

Log rotation limits the maximum size of a single log file, preventing the file from becoming too large to manage. The logging module provides a FileHandler class that supports automatic log rotation and creates new log files when the log file reaches a specified size or time limit.

# 创建一个带日志旋转的文件处理程序
file_handler = logging.handlers.RotatingFileHandler("my_log.log", maxBytes=1024, backupCount=5)

Performance optimization

The logging module incurs some overhead when recording log messages. To optimize performance, you can use the following tips:

  • Only log information useful for debugging or analysis.
  • Use filters to reduce log output.
  • Use efficient log format.
  • Avoid frequent creation and destruction of loggers.
  • Use an asynchronous logger to reduce main thread blocking.

By mastering these secret recipes of the Python logging module, you can create powerful logging systems and improve the reliability and debuggability of your applications.

The above is the detailed content of The secret recipe of Python's logging module: building an efficient logging system. For more information, please follow other related articles on the PHP Chinese website!

Statement
This article is reproduced at:编程网. If there is any infringement, please contact admin@php.cn delete
How to Use Python to Find the Zipf Distribution of a Text FileHow to Use Python to Find the Zipf Distribution of a Text FileMar 05, 2025 am 09:58 AM

This tutorial demonstrates how to use Python to process the statistical concept of Zipf's law and demonstrates the efficiency of Python's reading and sorting large text files when processing the law. You may be wondering what the term Zipf distribution means. To understand this term, we first need to define Zipf's law. Don't worry, I'll try to simplify the instructions. Zipf's Law Zipf's law simply means: in a large natural language corpus, the most frequently occurring words appear about twice as frequently as the second frequent words, three times as the third frequent words, four times as the fourth frequent words, and so on. Let's look at an example. If you look at the Brown corpus in American English, you will notice that the most frequent word is "th

Image Filtering in PythonImage Filtering in PythonMar 03, 2025 am 09:44 AM

Dealing with noisy images is a common problem, especially with mobile phone or low-resolution camera photos. This tutorial explores image filtering techniques in Python using OpenCV to tackle this issue. Image Filtering: A Powerful Tool Image filter

How Do I Use Beautiful Soup to Parse HTML?How Do I Use Beautiful Soup to Parse HTML?Mar 10, 2025 pm 06:54 PM

This article explains how to use Beautiful Soup, a Python library, to parse HTML. It details common methods like find(), find_all(), select(), and get_text() for data extraction, handling of diverse HTML structures and errors, and alternatives (Sel

How to Perform Deep Learning with TensorFlow or PyTorch?How to Perform Deep Learning with TensorFlow or PyTorch?Mar 10, 2025 pm 06:52 PM

This article compares TensorFlow and PyTorch for deep learning. It details the steps involved: data preparation, model building, training, evaluation, and deployment. Key differences between the frameworks, particularly regarding computational grap

Introduction to Parallel and Concurrent Programming in PythonIntroduction to Parallel and Concurrent Programming in PythonMar 03, 2025 am 10:32 AM

Python, a favorite for data science and processing, offers a rich ecosystem for high-performance computing. However, parallel programming in Python presents unique challenges. This tutorial explores these challenges, focusing on the Global Interprete

How to Implement Your Own Data Structure in PythonHow to Implement Your Own Data Structure in PythonMar 03, 2025 am 09:28 AM

This tutorial demonstrates creating a custom pipeline data structure in Python 3, leveraging classes and operator overloading for enhanced functionality. The pipeline's flexibility lies in its ability to apply a series of functions to a data set, ge

Serialization and Deserialization of Python Objects: Part 1Serialization and Deserialization of Python Objects: Part 1Mar 08, 2025 am 09:39 AM

Serialization and deserialization of Python objects are key aspects of any non-trivial program. If you save something to a Python file, you do object serialization and deserialization if you read the configuration file, or if you respond to an HTTP request. In a sense, serialization and deserialization are the most boring things in the world. Who cares about all these formats and protocols? You want to persist or stream some Python objects and retrieve them in full at a later time. This is a great way to see the world on a conceptual level. However, on a practical level, the serialization scheme, format or protocol you choose may determine the speed, security, freedom of maintenance status, and other aspects of the program

Mathematical Modules in Python: StatisticsMathematical Modules in Python: StatisticsMar 09, 2025 am 11:40 AM

Python's statistics module provides powerful data statistical analysis capabilities to help us quickly understand the overall characteristics of data, such as biostatistics and business analysis. Instead of looking at data points one by one, just look at statistics such as mean or variance to discover trends and features in the original data that may be ignored, and compare large datasets more easily and effectively. This tutorial will explain how to calculate the mean and measure the degree of dispersion of the dataset. Unless otherwise stated, all functions in this module support the calculation of the mean() function instead of simply summing the average. Floating point numbers can also be used. import random import statistics from fracti

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
1 months agoBy尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
4 weeks agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

PhpStorm Mac version

PhpStorm Mac version

The latest (2018.2.1) professional PHP integrated development tool

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools