Home > Article > Backend Development > The most detailed summary of Python libraries
#Library Name Introduction
Chardet character encoding detector can automatically detect the encoding of text, web pages, and xml. colorama is mainly used to add various colors to text, and is very simple and easy to use. Prettytable is mainly used to build formatted output on the terminal or browser side. difflib, [Python] standard library, calculates text difference Levenshtein, and quickly calculates string similarity. fuzzywuzzy String fuzzy matching. esmre Regular expression accelerator. shortuuid A set of concise URL/UUID function libraries. ftfy, Unicode text tool 7. unidecode, ascii and Unicode text conversion functions. xpinyin, a function library that converts Chinese characters into pinyin pangu.py, adjusts the spacing between letters and numbers in Chinese, Japanese and Korean characters. pyfiglet, a figlet program written in Python, uses characters to form ASCII art pictures. uniout, extracts the readable and writable characters in the string. awesome slugify, a Python slugify library for handling Unicode. python-slugify, a slugify function library that converts Unicode to ASCII internal code. unicode-slugify, generates unicode internal code, Django's dependency package. ply, the Python version of lex and yacc parsing tool phonenumbers, parses phone numbers, formats, stores and verifies international phone numbers. python-user-agents, a parser for browser user-agents. sqlparse, SQL parser. pygments, a general syntax highlighting tool. python-nameparser, parses names into separate components. pyparsing, a general parser generation framework. tablib, tabular data formats, including XLS, CSV, JSON, and YAML. python-docx, docx document reading, query and modification, docx files of Microsoft Word 2007/2008. xlwt/xlrd, read and write data files in Excel format. xlsxwriter, creates xlsx files in Excel format. xlwings, uses Python to call Excelcsvkit, CSV file toolkit. marmir, convert Python [data structure] into a spreadsheet. pdfminer, extract information from PDF files. pypdf2, a function library for merging and converting PDF pages. Python-Markdown, a Python implementation of the lightweight markup language Markdown. Mistune, a fast, full-featured Markdown interpreter written in pure Python. dateutil, an extension package of the standard Python official datetime module, a string date tool, in which parser is parsed into datetime according to the string, and rrule is generated according to the defined rules. datetime. arrow, a better date and time processing Python library chronyk, a Python 3 version function library, used to parse human-written times and dates. delorean, a function library for cleanup period. when.py provides user-friendly functions for seeing the date and time. moment, a date/time Python library similar to Moment.jspytz, world time zone, using tz database time zone information [database]BeautifulSoup, Python-based HTML/ The XML parser is easy to use and very powerful. It can parse even buggy or problematic HTML codes. lxml is a fast, easy-to-use, flexible HTML and XML processing library with super powerful functions. When encountering defective and non-standard xml, Python's own xml processor may not be able to parse it. When an error is reported, the program will try to parse again using lxml's repair mode. htmlparser, the official version parses the HTML DOM tree, occasionally used for automatic form submission from the command line. pyyaml, the Python version of the YAML interpreter. html5lib, - Standard library for parsing and serializing HTML documents and fragments. pyquery, an HTML interpreter function library similar to [jQuery]. cssutils, Python CSS library. MarkupSafe, XML or HTML/XHTML safe string markup tool. cssutils - ACSS library for Python., MarkupSafe - Implements a XML/HTML/XHTMLbleach, bleach, HTML-based whitelist function library. xmltodict, a JSON-like XML toolkit. xhtml2pdf, HTML/CSS format converter, generates pdf documents. untangle, convert XML documents into Python objects for easy access.File processing
Library name introduction Mimetypes, Python standard library, maps file names to MIME types. imghdr, Python standard library, determines the image type. python-magic, libmagic file type recognition library, Python interface format. path.py, a secondary encapsulation of the os.path module. watchdog, a set of API and shell utilities for monitoring file system events. Unipath, an object-oriented file/directory manipulation toolkit. pathlib, - (Python version 3.4 has been adopted as the Python standard library), a cross-platform, path-oriented function library. pickle/cPickle, Python's pickle module implements basic data sequence and deserialization. Through the serialization operation of the pickle module, we can save the object information running in the program to a file and store it permanently; through the deserialization operation of the pickle module, we can create the object saved by the last program from the file.cPickle is a version implemented in [C language], which is faster.
ConfigParser, Python standard library, INI file parser.
configobj, INI file parser.
config, hierarchical configuration, written by the logging author.
profig, a multi-format configuration conversion tool.
logging, Python standard library, log file generation management function library.
logbook, a replacement for logging.
Sentry, real-time log server.
Raven, the Python client for Sentry.
Sphinx, Sphinx (Sphinx), Python documentation generator.
reStructuredText, markup grammar and parsing tool, Docutils component.
mkdocs, Markdown format document generator.
pycco, a simple, fast, programming-style document generator.
pdoc, the automatically generated Python library API document epydoc, a tool for generating documents in various formats from source code comments.
Image processing
Library name introduction PIL (Python Image Library), a Python-based image processing library, is powerful, has extensive support for graphic file formats, and has many built-in Image processing functions, such as image enhancement, filtering [algorithms], etc.
Pillow, an image processing library, a fork and upgraded replacement of the PIL image library.
Matplotlib, a well-known drawing library, provides a complete set of command APIs similar to matlab to draw some high-quality mathematical two-dimensional graphics, which is very suitable for interactive drawing.
brewer2mpl has a professional python color matching toolkit that provides exquisite color matching from an artistic perspective.
PyGame is a Python-based multimedia development and game software development module that contains a large number of game and image processing functions.
Box2d, an open source 2D physics engine. Angry Birds was developed using this physics engine. The Box2d physics engine simulates a world internally. You can set the gravity in this world and then go to this Add various objects to the world and some of their physical properties, such as mass, friction, damping, etc.
Pymunk, an open source physical graphics simulation library similar to box2d.
OpenCV, currently the best open source image/vision library, includes many general algorithms for image processing, computer vision, and [machine learning].
SimpleCV, an open source computer vision framework, similar to opencv.
VTK, Visualization Toolkit (VTK, Visualization Toolkit) is an open source code, cross-platform, and supports parallel processing (VTK was used to process data of nearly 1 Petabyte in size. Its platform is Los Angeles, USA. Graphics application library for all Alamos National Laboratory large-scale systems with 1024 processors. In 2005, it was used by the U.S. Army Research Laboratory to instantly simulate the Russian anti-missile tank ZSU23-4 being attacked by a plane wave, with as many as 2.5 trillion computing nodes.
cgkit, Python Computer Graphics Kit, its modules are mainly divided into two parts
1. Some python modules related to 3D such as the vector, matrix and quaternion types, the RenderMan bindings, noise functions These modules can be used directly in programs with Python extensions such as maya houdini nuke blender;
2. Provides a module for complete scene operation. It is similar to other 3D software and retains complete information describing the scene in the memory. . It cannot be used directly in Maya, etc.
CGAL, Computational Geometry Algorithms Library, computational geometry algorithm library, provides computational geometry related data structures and algorithms, such as triangulation (2D constrained triangulation and two-dimensional and three-dimensional Delaunay triangulation), Voronoi Graphs (two-dimensional and three-dimensional points, 2D weighted Voronoi diagrams, segmented Voronoi diagrams, etc.), polygons (Boolean operations, offsets), polyhedra (Boolean operations), curve arrangement and its applications, mesh generation (two-dimensional Delaunay mesh generation and three-dimensional surface and volume mesh generation, etc.), geometry processing (surface mesh simplification, subdivision and parameterization, etc.), convex hull algorithm (2D, 3D and dD), search structures (nearest neighbor search, kd-tree, etc.), Interpolation, shape analysis, fitting, distance and more.
Aggdraw, an open source image library, covers almost all functions of 2D image operations and is very flexible to use.
Pycairo, open source vector drawing library
Cairo's python interface, cairo provides 2-D drawing on multiple backgrounds, and advanced ones can use hardware acceleration.
wand, Python binding wand tool (MagickWand), C language API interface.
thumbor, - Smart imaging tool to resize and flip images.
imgSeek, query similar images.
python-qrcode, a pure Python two-dimensional code (QR code) generator.
pyBarcode, create barcodes without PIL module.
pygram, Instagram like image filter.
Quads, computer art based on quadtrees.
nude.py, nude detection function.
scikit-image, the image processing library of the scikit toolbox.
hmap, image histogram tool.
bokeh, interactive web drawing.
plotly, Web collaborative Python and Matplotlib drawing.
vincent, Vincent, Python Vega function library.
d3py, Python drawing library, based on D3.JS, ggplot-API compatible with ggplot2.Kartograph.py of R language, draws beautiful SVG maps in Python.
pygal, creator of SVG charts.
pygraphviz, Python interface to Graphviz.
Fonttlools, ttf font tool function package, used for fontforge, ttx and other font software.
Games and Multimedia
Library name introduction audiolazy, a Python toolkit for digital signal processing (DSP).
audioread, cross-platform (GStreamer Core Audio MAD FFmpeg) audio decoding library.
beets, music library management. dejavu, audio fingerprinting algorithm.
Dejavu will record the fingerprint information of the audio after listening to it once, and then use the microphone to identify whether the input audio is the same song.
django-elastic-transcoder,Django Amazon elastic transcoding.
eyeD3, audio file tool, especially the ID3 metadata contained in MP3 files.
id3reader, used to read MP3 metadata.
mutagen, handles audio metadata.
pydub, - A simple high-level interface for manipulating audio.
pyechonest, Echo Nest API client.
talkbox, a Python library for speech and signal processing.
TimeSide, an open network audio processing framework.
tinytag, reads music file metadata, including MP3, OGG, FLAC and wave files.
m3u8, used to parse m3u8 files.
moviepy, multi-format video editing script module, including GIF animation.
shorten.tv, video summary. scikit-video, SciPy video processing routines.
GeoDjango, a world-class geographical web framework.
geopy, Geo geocoding toolbox.
pygeoip, GeoIP API written in pure Python.
GeoIP, Python API interface, uses the high-precision GeoIP Legacy Database database.
geojson, GeoJSON function library django-countries, a Django program that provides country selection, static files of flag icons, and a country's regional model.
Pygame, Python game design module.
Cocos2d, 2D game framework, demos, and other graphics/interaction applications, based on pyglet. Cocos2d- cocos2d is a framework for building 2D games, demos, and other graphical/interactive applications. It is based on pyglet.,PySDL2, SDL2 packaging library.
Panda3D- 3D game engine, developed by Disney. Written in C and fully compatible with Python.
PyOgre, OGRE 3D rendering engine, can be used for games, simulations, any 3D.
PyOpenGL, binds OpenGL and its related APIs.
PySFML, Python binding SFMLRenPy, visual novel engine.
Big Data and Scientific Computing
Library name introduction pycuda/opencl, GPU high-performance concurrent computing Pandas, a data statistics and analysis platform similar to R language implemented in python. Developed based on NumPy and Matplotlib, it is mainly used for data analysis and data visualization. Its data structure DataFrame is very similar to the data.frame in the R language. It has its own set of analysis mechanisms for time series data, which is very good.
Open Mining, business intelligence (BI), web interface for Pandas.
blaze, NumPy and Pandas big data interface.
SciPy, an open source Python algorithm library and mathematical toolkit, SciPy includes modules including optimization, linear algebra, integration, interpolation, special functions, fast Fourier transform, signal processing and image processing, ordinary differential Solving equations and other calculations commonly used in science and engineering. Its functions are similar to the software MATLAB, Scilab and GNU Octave. Numpy and Scipy are often used together, and most machine learning libraries in Python rely on these two modules.
ScientificPython, a selected set of Python program modules for scientific computing, including geometry (vectors, tensors, transformations, vector and tensor fields), quaternions, automatic derivatives, (linear ) interpolation, polynomials, basic statistics, nonlinear least squares fitting, unit calculations, Fortran-compatible text formats, 3D display via VRML, and two Tk gadgets for drawing line graphs and 3D mesh models respectively . Additionally there are interfaces to netCDF, MPI and BSPlib libraries.
NumPy scientific computing library provides solutions for matrices, linear algebra, Fourier transform, etc. The most commonly used is its N-dimensional array object. NumPy provides two basic objects: ndarray (N- dimensional array object) and ufunc (universal function object). ndarray is a multi-dimensional array that stores a single data type, and ufunc is a function that can process arrays.
Cvxopt, an optimization calculation package, can perform calculations of linear programming, quadratic programming, semi-definite programming, etc.
Numba, a scientific computing speed optimizing compiler.
pymvpa2 is a Python toolkit that provides statistical learning analysis for large data sets. It provides a flexible and extensible framework. It provides functions such as classification, regression, feature selection, data import and export, visualization, etc.
NetworkX, an optimization software package for complex networks.
zipline, a function library for trading algorithms.
PyDy, Python dynamic modeling function library.
SymPy, a Python library for symbolic mathematics.
statsmodels, statistical modeling and econometrics in Python.
astropy, the Python library in the astronomy community.
orange, orange, data mining, data visualization, learning machine analysis through visual programming or Python scripting. RDKit, software for chemical informatics and machine learning.
Open Babel, Babel, open chemical toolbox.
cclib, calculation function library for chemical software packages.
Biopython, a free biological computing toolkit.
bccb, a code set related to biological analysis.
bcbio-nextgen provides a fully automated, high-throughput, sequencing analysis toolkit.
visvis, a visual computing module library that can visualize one- to four-dimensional data.
MapReduce is a software [architecture] proposed by Google for parallel operations on large-scale data sets (larger than 1TB). The concepts "Map" and "Reduce", as well as their main ideas, are borrowed from the functional programming language MapReduce function library.
Framworks and libraries for MapReduce.,PySpark,[Spark]’s Python API. dpark, a Python clone of Spark, a MapReduce framework in Python.
luigi, build complex pipelines for batch work.
mrjob, a MapReduce job that runs on [Hadoop], or Amazon Web Services.
Artificial Intelligence and Machine Learning
Library name introductionNLTK (natural language toolkit) is a natural language processing toolkit for Python. Launched in 2001, it includes a large number of vocabulary libraries and algorithm implementations in natural language processing: word segmentation, root calculation, classification, semantic analysis, etc.
Pattern, data mining module, including natural language processing, machine learning tools, etc.
textblob provides API for natural language processing and decomposition of NLP tasks. Based on NLTK and Pattern modules.
jieba, stutter, Chinese word segmentation tool.
snownlp, used to process Chinese text libraries.
loso, Chinese word segmentation function library.
genius, Chinese CRF basic library, conditional random field (CRF), is a discriminant probability model, a type of random field, often used to label or analyze sequence data, such as natural Language text or biological sequence.
Gensim, a very professional topic model Python toolkit, whether it is code or documents, can be used to calculate the similarity of two documents LIBSVM, which was developed by Professor Lin Chih-Jen of National Taiwan University and others A simple, easy-to-use, fast and effective SVM pattern recognition and regression software package designed. It not only provides compiled executable files that can be used on Windows series systems, but also provides source code to facilitate improvements, modifications and other [ operating system]; this software has relatively few parameter adjustments involved in SVM, and provides a lot of default parameters. Many problems can be solved by using these default parameters; and it also provides the function of cross validation (Cross Validation). The software can solve problems such as C-SVM, ν-SVM, ε-SVR and ν-SVR, including multi-class pattern recognition problems based on one-to-one algorithms.
scikits.learn, a Python module for machine learning built on top of SciPy. It includes simple yet efficient tools for data mining and data analysis. Covers classification, regression and clustering algorithms, such as SVM, logistic regression, naive Bayes, random forest, k-means and other algorithms. The code and documentation are very good and have been used in many Python projects. For example, in the familiar NLTK, there is a special interface for scikit-learn on the classifier side. You can call scikit-learn's classification algorithm and training data to train the classifier model.
PyMC, machine learning sampling toolkit, scikit-learn seems to be everyone's darling, some people think that PyMC is more attractive. PyMC is mainly used for Bayesian analysis.
Orange, a component-based data mining and machine learning software suite, is a friendly, powerful, fast and versatile visual programming front-end for browsing data analysis and visualization, including a complete A set of components for data preprocessing and providing capabilities for data accounting, transitions, modeling, pattern evaluation and exploration. Focusing on data mining, it can be operated with visual languages or Python, has machine learning components, and also has plug-ins for bioinformatics and text mining.
Milk, a machine learning toolbox, focuses on providing supervised classification methods with several effective classification analyses: SVMs (based on libsvm), K-NN, random forest economics and decision trees. It also enables feature selection. These classifications can be combined in many ways to form different classification systems. For unsupervised learning, it provides K-means and affinity propagation clustering algorithms.
PyMVPA (Multivariate Pattern Analysis in Python) is a Python toolkit that provides statistical learning analysis for large data sets. It provides a flexible and extensible framework. It provides functions such as classification, regression, feature selection, data import and export, visualization, etc.
NuPIC, an open source artificial intelligence platform. The project was developed by Grok (formerly known as Numenta) and includes the company's algorithms and software architecture. NuPIC operates close to the human brain. "When the pattern changes, it forgets the old pattern and memorizes the new pattern." Like the human brain, the CLA algorithm can adapt to new changes.
Pylearn2, - Theano-based machine learning library.
hebel, GPU acceleration, [deep learning] Python library.
gensim, machine learning library.
pybrain, machine learning module, its goal is to provide flexible, adaptable, and powerful machine learning algorithms for machine learning tasks. Pybrain includes neural networks, reinforcement learning (and a combination of the two), unsupervised learning, and evolutionary algorithms. With neural network as the core, all training methods use neural network as an instance. Mahout is an open source project under the Apache Software Foundation (ASF). It provides some scalable implementations of classic algorithms in the field of machine learning, aiming to help developers Create smart applications more easily and quickly. Mahout contains many implementations, including clustering, classification, recommendation filtering, and frequent sub-item mining. Additionally, Mahout can efficiently scale to the cloud by using the Apache Hadoop library.
Crab, a flexible and fast recommendation engine.
python-recsys, entertainment system analysis, recommendation system.
vowpal_porpoise, Vowpal Wabbit lightweight Python package.
Theano, a python software package used to define, optimize and simulate mathematical expression calculations, and to efficiently solve multi-dimensional array calculation problems. It makes writing deep learning models easier while also giving some options for training them on GPUs.
System and command line
Library name introduction threading, Python standard thread library, higher-level thread interface.
envoy, envoy, Python sub-thread function library.
sh, a mature sub-thread replacement function library.
sarge, encapsulates threads.
subprocess, argparse, an artifact that calls shell commands, is necessary for writing command line scripts. Timeit, a powerful command line difference analysis tool, can calculate the time of code running, etc. unp, a command line tool, can decompress files.
Eventlet is a multi-threading module with low overhead, using the concept of green threads. For example, a statement such as pool = eventlet.GreenPool(10000) creates a thread pool that can handle 10,000 client connections. Similar to the Gevent thread library Gevent, the multi-thread module pytools, the famous python general function, toolkit SendKeys, keyboard and mouse operation module, simulate keyboard and mouse simulation operations.
pyHook, a "hook" library based on Python, is mainly used to monitor mouse and keyboard events on the current computer. This library depends on another Python library PyWin32. As the name shows, PyWin32 can only run on the Windows platform, so PyHook can only run on the Windows platform.
pstuil, cross-platform, it is very convenient to obtain and control the system's processes, as well as read the system's CPU usage, memory usage and other information.
cement, a lightweight, full-featured command Line tool.
click, a simple and elegant command line interface.
clint, Python command line tool.
cliff, a command line program framework for creating multi-level instructions.
Clime, can convert any module into multiple CLI command programs without any configuration.
docopt, Python command line parameter analyzer.
Pycli, a command line application, supports standard command line parsing, logging, unit [testing] and functional testing.
Gooey, open the command line program as a complete GUI application, cookiecutter, the command line tool to create projects from cookiecutters (project templates). For example, Python package project, jQuery plug-in project. percol, adds an interactive selection style to the traditional UNIX pipe command.
rainbowstream, a smart and beautiful Twitter client.
Django Models, part of Django SQLAlchemy, Python SQL toolkit and object-relational mapping.
peewee, a small ORM parser.
PonyORM provides a SQL-oriented interface for ORM.
MongoEngine, Python object file mapping, using [MongoDB]. , Django MongoDB engine MongoDB, Django backend.
django-mongodb-engine, Django backend. redisco, a simple model and container library, using [Redis] flywheel, Amazon DynamoDB object mapping.
butterdb, ORM for Google Spreadsheet, Python version.
celery, celery, asynchronous task queue/job, based on distributed message queue.
huey, Huey, lightweight, multi-threaded task queue.
mrq, Mr. Queue, distributed task queue, using redis & Gevent.
rq, a simple work queue.
Queue, the Queue module can be used to implement communication between multi-threads, allowing each thread to share data. The producer puts the goods into the Queue for consumers (threads) to use.
simpleq, a simple, scalable queue, Amazon SQS basic queue.
Psyco, a super powerful python performance optimization tool. The magic of psyco is that it only needs to call two lines of code at the entrance of the code, and the performance can be improved by 40% or more. It can be said to be an immediate effect! If your customer thinks your program is a bit slow, please don't rush to optimize the code. psyco may be able to change his mind immediately. psyco can be called Python’s jit. fn.py, Python Functional Programming: Missing Functionality Enjoy FP Implementation.
funcy, functional programming tool.
Toolz, functional programming tools: iterators, functions, dictionaries.
CyToolz, the Cython implementation of Toolz, a high-performance functional programming tool.
Ansible, Ansible, an extremely simple automation platform.
SaltStack, an automated management system for infrastructure.
Fabric, Fabric, a simple, remote execution and deployment language tool.
Fabtools, Fabric’s tool function.
cuisine, a popular Fabric tool function.
psutil, a cross-platform process and system tool module.
pexpect, control interactive programs.
provy, easy-to-use configuration system for Python.
honcho, Foreman’s Python interface, is used to manage procfile application tools.
gunnery, multi-task execution tool, distributed system with network interface.
fig, fast. Use Docker in a standalone development environment.
APScheduler, a lightweight but powerful online task scheduler.
django-schedule, Django schedule application.
doit, task flow channel/generation tool.
Joblib, a lightweight pipeline tool function provided by Python.
Plan, easily generate crontab files.
Spiff, a powerful workflow engine implemented in pure Python.
schedule, Python job scheduling.
TaskFlow, helps make task execution simple.
ctypes, Python standard library, faster, Python calls the external function interface of C code.
cffi, Python calls C code external function interface, similar to ctypes which directly calls c program in python program, but it is more convenient than ctypes and does not require compilation into so and then call.
Cytoolz, python acceleration library SWIG, simplifies packaging and interface generator.
Cython, Python optimizing static compiler.
PyPy, the Python implementation of the Python interpreter.
Stackless Python, an enhanced version of Python. It allows programmers to benefit from thread-based programming and avoid the performance and complexity problems caused by traditional threads. The micro-thread extension that Stackless brings to Python is a low-overhead, lightweight convenience tool Pyston, which uses LLVM and modern JIT technology to optimize the performance of Python.
pythonlibs, unofficial Windows (32/64-bit) Python extension package scapy, excellent packet processing library.
ino, Arduino command line tool.
Pyro, Python’s robotics toolkit.
pluginbase, a simple and flexible Python plug-in system.
itsdangerous, a tool for secure data transmission.
blinker, a signal/event scheduling system in fast Python.
pychievements for creating and tracking results frameworks.
python-patterns, design patterns in Python.
pefileWindows PE file parser SIP, a tool that automatically generates Python extension modules for C and C libraries.
Database
Library name introduction MySQLdb, mature [MySQL] database module, Baresql, SQL database package ZODB, Python local object database. A K-V object graph database.
pickledb, a simple and lightweight K-V key-value store.
TinyDB, lightweight, document-oriented database.
mysql-python, the Python tool library for MySQL.
mysqlclient, mysql-python branch, supports Python 3., PyMySQL, a MySQL driver written in pure Python, compatible with mysql-python.
mysql-connector-python, MySQL connector, from [Oracle], written in pure Python.
oursql, MySQL connector, provides local command statements and BLOBs support.
psycopg2, the most popular Python PostgreSQL adapter.
txpostgres, an asynchronous driver for Twisted, used in PostgreSQL.
queries, psycopg2 function library for PostgreSQL. dataset, stores Python dictionary data, for SQLite, MySQL and PostgreSQL.
cassandra-python-driver, the Python driver of the open source distributed NoSQL database system Apache Cassandra system.pycassa, a simplified cassandra database Python driver.
HappyBase, a friendly Apache [Hbase] function library.
PyMongo, the official client of MongoDB.
Plyvel, a fast and feature-rich Python interface to LevelDB.
redis-py, redis client.
py2neo, Python client (RESTful interface based on Neo4j).
telephus, cassandra client based on Twisted.
txRedis, a Redis client based on Twisted.
[Network]
Curl, Pycurl package is a Python interface to libcurl, which is written in C language. It is much faster compared to urllib. Libcurl is a client URL transfer library that supports FTP, FTPS, HTTP, HTTPS, GOPHER, TELNET, DICT, FILE and LDAP. libcurl also supports HTTPS authentication, HTTP POST, HTTP PUT, FTP upload, proxy, Cookies, basic authentication , FTP file breakpoint relay, HTTP proxy channel, etc.
Requests, written in Python language, is an open source HTTP library based on urllib. It's more convenient and more Pythoner-friendly than urllib. Support Python3.
httpie, a command-line HTTP client, a user-friendly replacement for cURL.
s3cmd, command line tool for managing Amazon S3 and CloudFront.
youtube-dl, command line program, download videos from YouTube.
you-get, a video download tool written in Python3, can be used for YouTube/Youku Youku/Niconico video download Coursera, download videos from coursera.org, rename files wikiteam, wiki download tool.
subliminal, command line tool, function library for searching and downloading subtitles.
requests, HTTP function library, more user-friendly.
grequests, asynchronous HTTP request Gevent (high performance and high concurrency function library).
urllib3, a thread-safe HTTP connection pool that supports file post.
httplib2, a comprehensive HTTP client function library.
treq, Python API interface, Twisted HTTP client.
Mininet, a popular network emulator, the API is written in python.
POX, an application based on Python's open source software-defined network (SDN) control development platform, such as OpenFlow's SDN controller.
Pyretic, the programming language for SDN, provides powerful abstractions over network switches or emulators.
SDX Platform, an IXP implementation based on SDN, takes advantage of minimal network, pox and heat.
inbox.py, Python’s SMTP server.
imbox, Python version of IMAP library.
inbox, inbox, open source email toolkit.
lamson, SMTP server.
flanker, Flanker, email address and MIME parsing library.
marrow.mailer, a high-performance scalable email delivery framework.
django-celery-ses, Django email backend, using AWS SES and Celery.
modoboa, email hosting and management platform including modern and simplified web UI.
envelopes, email tool.
mailjet, bulk mail mailjet API interface, with statistics.
Talon, Talon, Mailgun library to extract messages and signatures. mailjet - Mailjet API implementation for batch mailing, statistics and more., Talon - Mailgun library to extract message quotations and signatures., pyzmail, write, send and parse emails.
furl, fuel, a small URL parsing library.
purl, simple, clean API, manipulates URLs.
pyshorteners, pure Python library, URL shortener editing.
short_url, short URL generation.
Scrapy, a framework for fast screen capture and web scraping.
portia, Portia, a visual extension for Scrapy.
feedparser, information source interpreter.
RoboBrowser, a simple web browsing Python function library without using a web browser.
MechanicalSoup, website automated interactive testing toolkit.
mechanize, web browsing programming tool.
Demiurge, the Creator, - a lightweight tool for PyQuery.
newspaper, extract newspaper news.
html2text, convert HTML to text in Markdown format.
python-goose, HTML content extractor.
lassie, Lassie, humanized website content retrieval.
micawber, a function library for grabbing web pages through UR.
sumy, summary, automatic summarization module for text and HTML web pages.
Haul, a distance-based, scalable image crawler.
python-readability, readability tool Arc90, fast Python interface.
opengraph, OpenGraphProtocol protocol parsing module, textract, extract text from any file, Word, PowerPoint, PDF file, etc.
Sanitize, disinfect, and make chaotic data sane.
AutobahnPython, a function library for WebSocket and WAMP, using Twisted and PythonWebSocket-for-Python, a websocket client and server-side function library.
SimpleXMLRPCServer, python standard library, simple XML-RPC server, single thread. SimpleJSONRPCServer, JSON-RPC specification implementation function library.
zeroRPC, RPC implementation based on ZeroMQ and MessagePack.
apache-libcloud, Python interface library for all cloud services.
wifi, WiFi - A set of Python libraries and command line tools with WiFi, for [Linux].
streamparse, runs real-time streams of Python code and data. Integrated with Apache Storm.
boto, Amazon Web Services interface.
twython, Twitter API.
google-api-python-client, Google client API.
gspread, the Python API for Google Spreadsheet.
facebook-sdk, facebook platform Python SDK.
facepy, a simple facebook graphics API gmail, a Python interface for Gmail.
django-wordpress, Django models and views for WordPress.
Web Framework
Django, the most popular Python-Web framework, encourages rapid development and follows MVC design, with a short development cycle. ActiveGrid enterprise-level Web2.0 solution The solution is Karrigell's simple Web framework, which itself contains Web services, py script engine and pure python database
PyDBLitewebpy, a small and flexible Web framework, simple but powerful CherryPy Python-based Web application development framework .
Pylons, an extremely efficient and reliable web development framework based on Python.
Zope, an open source web application server.
TurboGears, a Python-based MVC style web application framework Twisted's popular network programming library, a large-scale web framework.
QuixoteWeb, development framework Flask, lightweight web framework.
Bottle, a fast, simple and lightweight WSGI pattern web framework.
Pyramid, a lightweight, fast and stable open source web framework.
web2py, a simple and easy-to-use full-stack web framework and platform.
web.py, a powerful and simple web framework.
TurboGears, an easy-to-extend web framework.
CherryPy, a minimalist Python web framework, supports HTTP 1.1 and WSGI thread pool.
Grok, a web framework based on Zope3.
Bluebream, an open source Web application server, formerly known as Zope 3.
guava, a lightweight, high-performance Python-Web framework, written in c language.
django-cms, based on Django enterprise-level open source CMS.
djedi-cms Lightweight yet powerful plugin for Django CMS, with inline editing and performance optimization.
FeinCMS, an advanced content management system based on Django.
Kotte, a high-level Python web application framework, based on Pyramid.
Mezzanine, a powerful, consistent and flexible content management platform.
Opps, a Django-based CMS for high-traffic newspapers, magazines and portals.
Plone, an open source application server based on Zope Zope.
Quokka, a flexible, scalable, lightweight CMS system using Flask and MongoDB.
Wagtail, Django content management system.
Widgy, CMS framework, based on Django.
django-oscar, Django Oscar, an open source e-commerce framework.
django-shop, an online store system based on Django.
merchant, supports multiple payment processing tools.
money, a scalable currency exchange solution.
python-currencies, currency display format.
cornice, Pyramid’s REST framework.
django-rest-framework, Django framework, a powerful and flexible tool that makes it easy to build Web APIs.
django-tastypie, create beautiful Django application API interfaces.
django-formapi, create JSON API, HMAC authentication and Django form validation.
flask-api, provides a unified browser experience, based on the Django framework.
flask-restful, quickly build REST API to support extensions.
flask-api-utils, an extension of flask.
falcon, Falcon, a high-performance Python framework for building cloud APIs and web application backends.
eve, Eve, REST API framework, using Flask, MongoDB and good intentions.
Sandman, Sandman, automatically generates REST APIs for existing database-driven systems.
restless, a framework similar to TastyPie.
savory-pie, REST API building function library (Django, and others) Jinja2, modern designer-friendly language template.
Genshi, a network-aware output template toolkit.
Mako, Marko, a super-fast, lightweight template for the Python platform.
Chameleon, Chameleon, an HTML/XML template engine. Modeled after ZPT, optimized for speed.
Spitfire, fast Python compilation template.
django-haystack, looking for a needle in a haystack, Django module search.
elasticsearch-py, the official low-level Python client of Elasticsearch.
solrpy, solr client.
Whoosh, fast, pure Python search engine library.
Feedly, a function library for building news and notification systems, using Cassandra and Redis.
django-activity-stream, Django activity stream, generates a universal activity stream from the actions on your website.
Beaker, a cache and session usage web application, standalone Python script and application library.
dogpile.cache is the next generation alternative work of Beaker author.
HermesCache, Python's caching library, tag-based invalidation and prevention of Dogpile effects.
django-cache-machine, Django cache machine, automatic cache invalidation, using ORM.
django-cacheops, automatic granular event-driven, ORM cache invalidation.
johnny-cache, Johnny cache framework, Django application.
django-viewlet, rendering template component extended cache control.
pylibmc, in the libmemcached interface.
WTForms-JSON, JSON form data processing extension.
Deform, a function library for HTML form generation.
django-bootstrap3, bootstrap3, integrated with Django.
django-crispy-forms, a Django program that can create elegant forms.
django-remote-forms, Django's remote form, serializer for Django tables.
django-simple-spam-blocker, Django’s simple spam blocker.
django-simple-captcha, Django simple captcha, simple and highly customizable Django application for adding captcha images Ajenti, server admin panel.
Grappelli, a django skin with a fancy interface.
django-suit, Django alternative o interface (for non-commercial use only).
django-xadmin, Django management panel replacement tool.
flask-admin, a simple flask management interface framework flower, real-time monitoring and Web management panel.
Pelican, Pelican, Markdown or ReST, Ziwang content theme. Support DVCS, Disqus. AGPL.
Cactus, cactus, designer's website static generator.
Hyde, Hyde, a static website generator based on Jinja2.
Nikola, Nikola - a static website and blog generator.
Tags, tags, the simplest static website generator.
Tinkerer, Tinkerer, a static website generator based on Sphinx.
asyncio, (Python standard library in Python 3.4), asynchronous I/O, event loop, collaborative tasks.
gevent, a Python-based network library.
Twisted, event-driven network engine.
Tornado, Tornado, web framework and function library for asynchronous networks.
pulsar, an event-driven parallel framework for Python.
diesel, diesel, green, event-based I/O framework.
Eventlet, WSGI supports asynchronous framework.
pyzmq, Python package of 0MQ message library.
txZMQ, based on Twisted's 0MQ message library and Crossbar, open source unified application router (WebSocket and WAMP).
wsgiref, Python standard library, WSGI encapsulation implementation, single thread.
Werkzeug, machine tool, WSGI tool function library, can be easily embedded into your own project framework.
paste, paste, multi-threaded, stable, proven WSGI tool.
rocket, rocket, multi-threaded service, based on Pyramid.
netius, a fast, asynchronous WSGI server, gunicorn, the predecessor of forked, partly written in C.
fapws3, asynchronous network, written in C.
meinheld, an asynchronous WSGI server, is written in C.
bjoern, a fast, asynchronous WSGI server, written in C.
Security
Permissions function library, allowing or denying users access to data or functions.
django-guardian, Django guardian, manages permissions of each object, used in Django 1.2 Carteblanche, manages navigation and permissions.
Authomatic, a simple and powerful authentication/authorization client.
OAuthLib, universal, normative, OAuth request signing tool.
rauth, Python library for OAuth 1.0, 2.0,.
python-oauth2, utilizes fully tested, abstract interfaces to create OAuth clients and servers.
python-social-auth, an easy-to-install social authentication mechanism.
django-oauth-toolkit, Django OAuth toolkit django-oauth2-provider, Django OAuth2 toolkit.
django-allauth, Django authentication application.
Flask-OAuthlib, Flask's OAuth toolkit sanction, sanction, simple oauth2 client.
jose, [JavaScript] Object Signing and Encryption (JOSE) draft implementation, flag status.
python-jwt, JSON web token generation and verification module.
pyjwt, JSON Web Token Draft 01.
python-jws, JSON Web Token Draft 02.
PyCrypto, Python encryption toolkit.
Paramiko, the implementation of the sshv2 protocol, provides client and server-side functions.
cryptography, cryptography development kit.
PyNac, network and password (NaCl) function library.
hashids, the Python function library of hashids.
Passlib, secure password storage/hashing library, very high level.
hashlib, md5, sha and other hash algorithms are used to replace the md5 and sha modules and make their APIs consistent.
It is supported by OpenSSL and supports the following algorithms: md5, sha1, sha224, sha256, sha384, sha512.
GUI Library
Name introduction PyGtk, GUI program development based on Python GTK library PyQt is a GUI programming framework under WxPython, the QT development library for Python. Its message mechanism is similar to the MFC architecture. Getting started is very simple. If you need to quickly develop related applications, you can use this standard interface programming package under TkinterPython, so it is not a third-party library. PySide is a cross-platform Qt application and user interface framework that supports the Qt v4 framework.
wxPython, a C library that mixes wxWidgets.
kivy, a library for creating application GUI functions, running on Windows, Linux, MAC OS X, [Android] and [iOS].
curse, used to create terminal GUI applications.
urwid, a function library for creating terminal GUI application forms, supports events and is rich in color.
pyglet, a cross-platform windowing and multimedia library for Python.
Tkinter is the de facto standard GUI software package for Python.
enaml, create beautiful user interface, syntax similar to QML.
Toga, Toga, OS native GUI toolkit. [Build Package]
pyenv, simple Python version management.
virtualenv, creates an independent Python environment for installing different versions of python environments at the same time.
virtualenvwrapper is a set of extensions for virtualenv.
pew, a set of tools for managing multiple virtual environments.
vex, causes the specified virtualenv command to be run.
PyRun, a single-file, no installation required Python version management tool.
PIP, a management tool for Python packages and dependencies.
easy_install, a software package management system, provides a standard format for distributing Python software and libraries. It is a module with configuration tools and a third-party function library. Designed to speed up the distribution of Python libraries. RubyGems similar to the Ruby language.
conda, cross-platform, binary package manager.
Curdling, a command line tool for managing Python packages.
wheel, a new standard for Python distribution, aims to replace eggs.cx-Freeze, a cross-platform library used to package into executable files.
py2exe, Freeze script tool for Windows platform, Py2exe, converts python script into executable program py2app that can run independently on Windows, Freeze script tool for MAC OS X platform.
pyinstaller, a Python program converted into a stand-alone executable file (cross-platform).
pynsist, a tool for building Windows installers, written in Python.
dh-virtualenv, create and distribute virtualenv (Debian software package format)
PyPI, a new generation of Python package library management tool. warehouse, a new generation of Python package library (PyPI) management tool.
devpi, PyPI server and packaging/testing/release tools.
localshop, PyPI official package mirror server, supports local (private) package upload.
buildout, creates, assembles and deploys multiple parts of an application, some of which may be non-Python based.
SCons, software construction tool.
platformio, a console tool, builds code that can be used on different development platforms.
bitbake, a specially designed tool for creating and deploying [embedded] Linux software packages
fabricate, automatically generates dependency packages for any programming language.
django-compressor, Django compressor, compresses and inlines JavaScript or CSS, linking it to a single cached file.
jinja-assets-compressor, Jinja Compressor, a Jinja extension, compresses your resources through compilation.
webassets, optimized management, static resources, unique cache clearing.
fanstatic, fans, package optimization, providing static files.
fileconveyor, monitors resource changes and can be saved to CDN (content distribution network) and file systems.
django-storages, a set of custom storage Django backends.
glue, glue, a simple command line tool to generate CSS Sprites.
libsass-python, Python interface for Sass (cascading style sheets).
Flask-Assets, integrate application resources. [Code Debugging]
unittest, Python standard library, unit testing framework.
nose, nose, unittest extension product.
pytest, a mature and full-featured Python testing tool.
mamba, Mamba, Python's authoritative testing tool, comes from BDD.
contexts, background, BDD testing framework, based on C#.
pyshould, should style testing framework, based on PyHamcrest.pyvows, BDD style testing framework Selenium, web testing framework, Python binding Selenium.
splinter, split, an open source tool for testing web applications.
locust, Black Locust, an extensible user load testing tool, written in Python.
sixpack, a language-independent A/B testing framework.
Mock, simulation object (English: mock object, also translated as imitation object), simulation test library.
responses, tool function, used for mock simulation testing.
doublex, a powerful testing framework.
freezegun, adjust the time and test the module.
httpretty, a simulation tool for HTTP requests.
httmock, mock simulation test.
coverage, code coverage measurement test.
faker, a Python package that generates simulated test data.
mixer, mixer, generates simulated data, used for Django ORM, SQLAlchemy, Peewee, MongoEngine, Pony ORM, etc. model_mommy, creates test random tools in Django.
ForgeryPy, an easy-to-use simulation data generator.
radar, radar, generates random dates/times.
FuckIt.py, test Python code running.
Code Analysispysonar2, Python type index.
pycallgraph, a visual traffic (call graph) application.
code2flow, convert Python and JavaScript code into flowcharts.
LinterFlake8, source code module checker pylama, Python and JavaScript code audit tool.
Pylint, a source code analyzer, finds programming errors, helps enforce a code standard and sniffs out some code smells. Note: Compared to PyChecker, Pylint is a high-level Python code analysis tool that analyzes errors in Python code.
Pyflakes, a simple program for checking Python source files for errors. Pyflakes analyzes programs and checks for various errors. It does this by parsing source files, no imports required.
pdb, Python standard library, Python debugger.
ipdb, the PDB used by IPython.
winpdb, a platform-independent GUI debugger.
pudb, full screen, based on python debugging console.
pyringe, a debugger that can be attached to and inject code into Python programs.
python-statsd, statsd server client.
memory_profiler, memory monitoring.
profiling, interactive Python profiler.
django-debug-toolbar, Django debugging toolbar, displays various debugging information: current request/response.
django-devserver, Django debugging tool.
flask-debugtoolbar, flask debugging tool.
PHP website has a large number of free Python introductory tutorials, everyone is welcome to learn.
This article is reproduced from: https://www.jianshu.com/p/d25a9169fe86
The above is the detailed content of The most detailed summary of Python libraries. For more information, please follow other related articles on the PHP Chinese website!