search
HomeBackend DevelopmentPython TutorialHow to use KNN algorithm for classification in Python?
How to use KNN algorithm for classification in Python?Jun 05, 2023 am 09:02 AM
pythonClassificationknn algorithm

K nearest neighbor algorithm (KNN) is a simple and effective algorithm that can be used for classification and regression. Its basic idea is to identify the category to which a sample belongs by measuring the distance between different features. In this article, we will explore how to classify KNN in Python.

1. Prepare the data set

First, we need to prepare the data set. In this example, we will use the Iris dataset, which contains 3 different iris flowers (Setosa, Versicolour and Virginica), each with 4 features (Sepal Length, Sepal Width, Petal Length, Petal Width).

We will use the Pandas library to read and preprocess the data. First, we need to import the required libraries:

import pandas as pd
import numpy as np
import matplotlib.pyplot as plt

Then, we will load the dataset:

url = "https://archive.ics.uci.edu/ml/machine-learning-databases/iris/iris.data"
names = ['sepal-length', 'sepal-width', 'petal-length', 'petal-width', 'class']
dataset = pd.read_csv(url, names=names)

Now that we have a dataset, we can start exploring it.

2. Data Visualization

Before classifying, we need to visualize and explore the data. We will plot a scatterplot of each feature against another feature, as well as a histogram of each feature. We can use Matplotlib library and Seaborn library for visualization.

Scatter plot between features:

import seaborn as sns
sns.pairplot(dataset, hue="class")

How to use KNN algorithm for classification in Python?

As can be seen from this picture, the characteristics of different iris flowers are very different, which is the basis for classification.

Histogram of each feature:

dataset.hist()
plt.show()

How to use KNN algorithm for classification in Python?

As can be seen from this figure, each feature in the data set has a different distribution, which is the basis for normalization.

3. Data preprocessing

Before classification, we need to preprocess the data. We can split the dataset into input features and output categories, and then scale the feature values ​​to the range of 0 to 1.

First, we split the dataset into input features and output categories:

X = dataset.iloc[:, :-1].values
y = dataset.iloc[:, 4].values

Then, we scale the feature values ​​to the range of 0 to 1:

from sklearn.preprocessing import StandardScaler
scaler = StandardScaler()
X = scaler.fit_transform(X)

Now, we have our preprocessed dataset.

4. Split the data set

Before classification, we need to split the data set into a training set and a test set. We can do this using the train_test_split function from the Scikit-learn library.

from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=0)

This will create a training set and a test set with a ratio of 80:20.

5. Training the KNN model

Now, we can start training the KNN model. We first import the KNeighborsClassifier class, create an instance, and use the fit function to fit the model.

from sklearn.neighbors import KNeighborsClassifier
classifier = KNeighborsClassifier(n_neighbors=5)
classifier.fit(X_train, y_train)

This will create a KNN classifier and train it to classify using the training set.

6. Prediction

Now, we can use the KNN model to predict the test set. We use the predict function to make predictions and save the results into a variable.

y_pred = classifier.predict(X_test)

7. Model Evaluation

Finally, we need to evaluate our model and determine its accuracy. We can use the confusion_matrix and classification_report functions in the Scikit-learn library to evaluate the accuracy of the model.

from sklearn.metrics import confusion_matrix, classification_report
print(confusion_matrix(y_test, y_pred))
print(classification_report(y_test, y_pred))

This will output a confusion matrix and classification report showing the accuracy of our model.

Summary

Using the KNN algorithm for classification in Python requires the following steps:

1. Preparing the data set
2. Data visualization
3. Data Preprocessing
4.Split the data set
5.Train KNN model
6.Prediction
7.Model evaluation

The KNN algorithm is a simple and effective algorithm that can Used for classification and regression. Using the KNN algorithm for classification in Python requires following the above steps. At the same time, we also need to perform data visualization and preprocessing to ensure that our model can accurately classify.

The above is the detailed content of How to use KNN algorithm for classification in Python?. For more information, please follow other related articles on the PHP Chinese website!

Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
详细讲解Python之Seaborn(数据可视化)详细讲解Python之Seaborn(数据可视化)Apr 21, 2022 pm 06:08 PM

本篇文章给大家带来了关于Python的相关知识,其中主要介绍了关于Seaborn的相关问题,包括了数据可视化处理的散点图、折线图、条形图等等内容,下面一起来看一下,希望对大家有帮助。

详细了解Python进程池与进程锁详细了解Python进程池与进程锁May 10, 2022 pm 06:11 PM

本篇文章给大家带来了关于Python的相关知识,其中主要介绍了关于进程池与进程锁的相关问题,包括进程池的创建模块,进程池函数等等内容,下面一起来看一下,希望对大家有帮助。

Python自动化实践之筛选简历Python自动化实践之筛选简历Jun 07, 2022 pm 06:59 PM

本篇文章给大家带来了关于Python的相关知识,其中主要介绍了关于简历筛选的相关问题,包括了定义 ReadDoc 类用以读取 word 文件以及定义 search_word 函数用以筛选的相关内容,下面一起来看一下,希望对大家有帮助。

归纳总结Python标准库归纳总结Python标准库May 03, 2022 am 09:00 AM

本篇文章给大家带来了关于Python的相关知识,其中主要介绍了关于标准库总结的相关问题,下面一起来看一下,希望对大家有帮助。

分享10款高效的VSCode插件,总有一款能够惊艳到你!!分享10款高效的VSCode插件,总有一款能够惊艳到你!!Mar 09, 2021 am 10:15 AM

VS Code的确是一款非常热门、有强大用户基础的一款开发工具。本文给大家介绍一下10款高效、好用的插件,能够让原本单薄的VS Code如虎添翼,开发效率顿时提升到一个新的阶段。

Python数据类型详解之字符串、数字Python数据类型详解之字符串、数字Apr 27, 2022 pm 07:27 PM

本篇文章给大家带来了关于Python的相关知识,其中主要介绍了关于数据类型之字符串、数字的相关问题,下面一起来看一下,希望对大家有帮助。

python中文是什么意思python中文是什么意思Jun 24, 2019 pm 02:22 PM

pythn的中文意思是巨蟒、蟒蛇。1989年圣诞节期间,Guido van Rossum在家闲的没事干,为了跟朋友庆祝圣诞节,决定发明一种全新的脚本语言。他很喜欢一个肥皂剧叫Monty Python,所以便把这门语言叫做python。

详细介绍python的numpy模块详细介绍python的numpy模块May 19, 2022 am 11:43 AM

本篇文章给大家带来了关于Python的相关知识,其中主要介绍了关于numpy模块的相关问题,Numpy是Numerical Python extensions的缩写,字面意思是Python数值计算扩展,下面一起来看一下,希望对大家有帮助。

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
2 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
Repo: How To Revive Teammates
1 months agoBy尊渡假赌尊渡假赌尊渡假赌
Hello Kitty Island Adventure: How To Get Giant Seeds
4 weeks agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

mPDF

mPDF

mPDF is a PHP library that can generate PDF files from UTF-8 encoded HTML. The original author, Ian Back, wrote mPDF to output PDF files "on the fly" from his website and handle different languages. It is slower than original scripts like HTML2FPDF and produces larger files when using Unicode fonts, but supports CSS styles etc. and has a lot of enhancements. Supports almost all languages, including RTL (Arabic and Hebrew) and CJK (Chinese, Japanese and Korean). Supports nested block-level elements (such as P, DIV),

SublimeText3 Linux new version

SublimeText3 Linux new version

SublimeText3 Linux latest version

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

PhpStorm Mac version

PhpStorm Mac version

The latest (2018.2.1) professional PHP integrated development tool

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools