search

regular expression

Jul 21, 2017 am 10:03 AM
linuxtextexpression

1. Regular expression

1. Type of matching characters

  • [a-z]: lowercase letters

  • [A-Z]: Uppercase letters

  • [a-Z]: Small or uppercase letters

  • [0-9]: Numbers

  • [a-zA-Z0-9]: Matches a character that is a letter or number

  • . : Matches any character, except spaces

  • [0-f]: Hexadecimal number

  • abc | def: abc or def

  • a (bc | de) f: abcf or adef

  • \<: the first word is usually separated by spaces or special characters and continuous string regarded as>

  • \>: Word ending

  • [^expression]: All characters except lowercase letters, and so on.

2, followed by the following symbols to control the number of matches

The left side of such symbols must have the expression of the first point above

  • Expression*: 0 or n characters

  • Expression+: 1 or n characters

  • Expression?: 0 or 1 characters

  • Expression {n}: n characters

  • Expression {n:m}: n to m Characters

  • Expression {n,}: at least n characters

[Example] [a-z]* means matching 0 Or multiple lowercase letters

3. Control the matching characters at the beginning and end

  • ^ Expression: The head matches

  • Expression$: The tail matches

2. Three major Linux text processing tools

1. egrep filtering tool

Extended version of grep, you can use regular expressions

Syntax:

egrep - option 'regular expression' file name

Options:

  • -n: Display line number

  • ##-o: Display only matching content

  • -q: Silent mode, no output, you have to use $? to judge whether the execution is successful, that is, whether the desired content is filtered

  • - l: If the match is successful, only the file name will be printed. If it fails, it will not be printed. Usually -rl is used together, grep -rl 'root' /etc

  • -A: If it matches If successful, the matching line and the following n lines will be printed together

  • -B: If the match is successful, the matching line and the first n lines will be printed out

  • -C: If the match is successful, print out the matching line and n lines before and after it

  • --color

  • -c: If the match is successful, print out the number of matched lines

  • -i: Ignore case

  • - v: Negate, do not match

  • -w: Match the word

2, sed stream editor

Grammar:

Syntax 1: sed - option 'numeric positioning + command' file name

Option:

  • -n: Silent mode, no output

  • -e: Multiple edits, this is not very clear

  • -i: Direct modification File content instead of output

  • -r: Extended mode, you can use regular expressions

  • -f: Specify the file name, the action Write in a new file

Positioning:

① Numeric positioning (input line number positioning)

  • 1: Single line

  • 1,3: Range from the first line to the third line

  • 2 ,+4: Several lines after the matching line

  • 4,~3: From the fourth line to the next multiple of 3

  • 2 ~3: Every three lines starting from the second line

  • $: The last line

  • 1!: Lines other than the first line

【Example】sed -n '1p' /etc/passwd

②Regular expression positioning

  • Regular expressions must be wrapped with //

  • Expanding regular expressions requires the -r parameter or escaping

  • Replace sub-patterns that can use regular expressions, that is, parentheses (), \1 and \2 can represent sub-patterns

[Example] sed -r 's/ (.)(.)/\2\1/ file1 means to replace the first and second parts of the match

*Greedy option: fill in g, which means to replace all the matching parts in one line Matching item replacement

Command:

  • a: Append,

  • c ∶ Change change,

  • d ∶ Delete delete,

  • #i ∶ Insert, i can be followed by strings, and these strings Will appear on a new line (the current previous line)

  • p: print print

  • s: replace substitute, you can replace it directly work. Usually this s action can be paired with a regular expression. For example, 1,20s/old/new/g

*s command special instructions:

Use {Command 1: Command 2: Command 3} Multiple commands can be added

sCommand syntax: sed -r 'Replacement command s/regular expression/replacement content/greedy option g' File name

3, awk text analysis tool

Composed of commands, regular expressions (need to be surrounded by //), comparisons and relational operations

Use the -F parameter in option to define the interval symbol

Use the order of $1, $2, $3, etc. to represent the different fields in each column separated by spacers in each row of files. The NF variable represents the number of fields in the current record.

Syntax

awk - Option parameters 'Logical judgment {command variable 1, variable 2, variable 3}' File name

Option

  • -F Define field separator , the default delimiter is consecutive spaces or tabs

  • -v. Define variables and assign values. You can also use the borrowed method to introduce

from shell variables.

AWK variable

  • NR The number of current records (statistics after all files are connected)

  • FNR The number of current records (only statistics for the current file, not all)

  • FS field separator defaults to consecutive spaces or tabs, and multiple different symbols can be used for separation. Symbol -F[:/]

  • OFS The default separator for output characters is a space

[OFS example]

# awk -F: 'OFS="=====" {print $1,$2}' /etc/passwd
root===== x

  • NF The number of fields in the currently read row

  • ORS The output record separator defaults to newline

【ORS example】

# awk -F: 'ORS="=====" {print $1,$2}' /etc/ passwd
root x=====bin x=====

  • FILENAME Current file name

[Example 1] Using AWK variables
# awk '{print NR,FNR,$1}' file1 file2
1 1 aaaaa
2 2 bbbbb
3 3 ccccc
4 1 dddddd
5 2 eeeeee
6 3 ffffff

#[Example 2]How to quote shell variables

# a=root
# awk -v var=$a -F: '$1 == var {print $0}' /etc/passwd
Or split the entire command and pass it to expose the shell variables,
# awk -F: '$1 == "'$a'" {print $0}' /etc/passwd
# a=NF
# awk -F: '{print $'$a'}' /etc/passwd

Logical operations (can directly reference fields for operations)

  • = += -= / = *=: Assignment

  • && || !: Logical and logical or logical non-

  • ~ !~: Match regular or not match, Regular expressions need to be surrounded by /regular/

  • ## >= != ==: relationship, when comparing strings, the strings must be enclosed in double quotes

  • $: Field references need to be added with $, while variable references are directly taken from variable names

  • + - * / % ++ --: Operation Symbol

Escape sequence

  • \\ \self

  • \$ escape$

  • \t tab character

  • \b backspace character

  • \r Carriage return character

  • \n Line feed character

  • \c Cancel line feed

Please correct me if there are any errors. For more details, please refer to:


The above is the detailed content of regular expression. For more information, please follow other related articles on the PHP Chinese website!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Linux Operations: Utilizing the Maintenance ModeLinux Operations: Utilizing the Maintenance ModeApr 19, 2025 am 12:08 AM

Linux maintenance mode can be entered through the GRUB menu. The specific steps are: 1) Select the kernel in the GRUB menu and press 'e' to edit, 2) Add 'single' or '1' at the end of the 'linux' line, 3) Press Ctrl X to start. Maintenance mode provides a secure environment for tasks such as system repair, password reset and system upgrade.

Linux: How to Enter Recovery Mode (and Maintenance)Linux: How to Enter Recovery Mode (and Maintenance)Apr 18, 2025 am 12:05 AM

The steps to enter Linux recovery mode are: 1. Restart the system and press the specific key to enter the GRUB menu; 2. Select the option with (recoverymode); 3. Select the operation in the recovery mode menu, such as fsck or root. Recovery mode allows you to start the system in single-user mode, perform file system checks and repairs, edit configuration files, and other operations to help solve system problems.

Linux's Essential Components: Explained for BeginnersLinux's Essential Components: Explained for BeginnersApr 17, 2025 am 12:08 AM

The core components of Linux include the kernel, file system, shell and common tools. 1. The kernel manages hardware resources and provides basic services. 2. The file system organizes and stores data. 3. Shell is the interface for users to interact with the system. 4. Common tools help complete daily tasks.

Linux: A Look at Its Fundamental StructureLinux: A Look at Its Fundamental StructureApr 16, 2025 am 12:01 AM

The basic structure of Linux includes the kernel, file system, and shell. 1) Kernel management hardware resources and use uname-r to view the version. 2) The EXT4 file system supports large files and logs and is created using mkfs.ext4. 3) Shell provides command line interaction such as Bash, and lists files using ls-l.

Linux Operations: System Administration and MaintenanceLinux Operations: System Administration and MaintenanceApr 15, 2025 am 12:10 AM

The key steps in Linux system management and maintenance include: 1) Master the basic knowledge, such as file system structure and user management; 2) Carry out system monitoring and resource management, use top, htop and other tools; 3) Use system logs to troubleshoot, use journalctl and other tools; 4) Write automated scripts and task scheduling, use cron tools; 5) implement security management and protection, configure firewalls through iptables; 6) Carry out performance optimization and best practices, adjust kernel parameters and develop good habits.

Understanding Linux's Maintenance Mode: The EssentialsUnderstanding Linux's Maintenance Mode: The EssentialsApr 14, 2025 am 12:04 AM

Linux maintenance mode is entered by adding init=/bin/bash or single parameters at startup. 1. Enter maintenance mode: Edit the GRUB menu and add startup parameters. 2. Remount the file system to read and write mode: mount-oremount,rw/. 3. Repair the file system: Use the fsck command, such as fsck/dev/sda1. 4. Back up the data and operate with caution to avoid data loss.

How Debian improves Hadoop data processing speedHow Debian improves Hadoop data processing speedApr 13, 2025 am 11:54 AM

This article discusses how to improve Hadoop data processing efficiency on Debian systems. Optimization strategies cover hardware upgrades, operating system parameter adjustments, Hadoop configuration modifications, and the use of efficient algorithms and tools. 1. Hardware resource strengthening ensures that all nodes have consistent hardware configurations, especially paying attention to CPU, memory and network equipment performance. Choosing high-performance hardware components is essential to improve overall processing speed. 2. Operating system tunes file descriptors and network connections: Modify the /etc/security/limits.conf file to increase the upper limit of file descriptors and network connections allowed to be opened at the same time by the system. JVM parameter adjustment: Adjust in hadoop-env.sh file

How to learn Debian syslogHow to learn Debian syslogApr 13, 2025 am 11:51 AM

This guide will guide you to learn how to use Syslog in Debian systems. Syslog is a key service in Linux systems for logging system and application log messages. It helps administrators monitor and analyze system activity to quickly identify and resolve problems. 1. Basic knowledge of Syslog The core functions of Syslog include: centrally collecting and managing log messages; supporting multiple log output formats and target locations (such as files or networks); providing real-time log viewing and filtering functions. 2. Install and configure Syslog (using Rsyslog) The Debian system uses Rsyslog by default. You can install it with the following command: sudoaptupdatesud

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Tools

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

SublimeText3 English version

SublimeText3 English version

Recommended: Win version, supports code prompts!

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft