Ollama - Custom Model - llama

Import the ollama library.

import ollama

Create a class to configure custom models.

Methods:

• init: Initializes the model with attributes such as name, system and temperature.
• name_custom: Returns the custom name.
• get_description: Creates the ModelFile structure.

class ModelFile:
    def __init__(self, model: str, name_custom: str, system: str, temp: float = 0.1) -> None:
        self.__model = model
        self.__name_custom = name_custom
        self.__system = system
        self.__temp = temp

    @property
    def name_custom(self):
        return self.__name_custom

    def get_description(self):
        return (
            f"FROM {self.__model}\n"
            f"SYSTEM {self.__system}\n"
            f"PARAMETER temperature {self.__temp}\n"
        )

• Create a function to list all available models.
• Output: Returns a list of models registered in ollama.

def ollama_list() -> None:
    response_ollama = ollama.list()
    return response_ollama['models']

Create a function to build a custom model based on the passed configuration.

def ollama_build(custom_config: ModelFile) -> None:
    ollama.create(
        model=custom_config.name_custom,
        modelfile=custom_config.get_description()
    )

Create a function to check if the custom model exists.

def check_custom_model(name_model) -> None:
    models = ollama_list()
    models_names = [model['name'] for model in models]
    if f'{name_model}:latest' in models_names:
        print('Exists')
    else:
        raise Exception('Model does not exists')

Create a function to generate a response based on the provided template and prompt.

def ollama_generate(name_model, prompt) -> None:
    response_ollama = ollama.generate(
        model=name_model,
        prompt=prompt
    )
    print(response_ollama['response'])

Create a function to delete a model by name.

def ollama_delete(name_model) -> None:
    ollama.delete(name_model)

Create a function to Order the steps of building, verifying and using the model.

def main(custom_config: ModelFile, prompt) -> None:
    ollama_build(custom_config)
    check_custom_model(custom_config.name_custom)
    ollama_generate(custom_config.name_custom, prompt)
    # ollama_delete(custom_config.name_custom)

Set the prompt and configure the Model File template.

Input:

• Model: llama3.2
• Custom name: xeroxvaldo_sharopildo
• System: Smart anime assistant.

Output: Runs the main function to create the model, check for its existence, and generate a response to the prompt.

if __name__ == "__main__":
    prompt: str = 'Who is Naruto Uzumaki ?'
    MF: ModelFile = ModelFile(
        model='llama3.2',
        name_custom='xeroxvaldo_sharopildo',
        system='You are very smart assistant who knows everything about Anime',
    )
    main(MF, prompt)

output:

Naruto Uzumaki is the main protagonist of the popular Japanese manga and anime series "Naruto," created by Masashi Kishimoto. He is a young ninja from the Hidden Leaf Village, who dreams of becoming the Hokage, the leader of his village.

Naruto is known for his determination, bravery, and strong sense of justice. He is also famous for his unique ninja style, which involves using his Nine-Tails chakra (a powerful energy that he possesses) to enhance his physical abilities.

Throughout the series, Naruto faces numerous challenges and adversaries, including other ninjas from different villages, as well as powerful enemies like Akatsuki members and the Ten-Tails' jinchuriki. Despite facing many setbacks and failures, Naruto perseveres and grows stronger with each challenge he overcomes.

Naruto's character development is a central theme of the series, as he learns valuable lessons about friendship, sacrifice, and the true meaning of being a ninja. His relationships with his teammates, Sakura Haruno and Sasuke Uchiha, are particularly significant in shaping his personality and growth.

The Naruto series consists of two main arcs: the original "Naruto" arc (2002-2007) and the "Naruto Shippuden" arc (2007-2014). The latter is a continuation of the first arc, with Naruto now older and more powerful.

Overall, Naruto Uzumaki is an iconic anime character who has captured the hearts of millions worldwide. His inspiring story and memorable personality have made him one of the most beloved characters in anime history!

import ollama

References

• Ollama
• Notebook this project
• Ollama Model Custom

Author's notes

Thank you very much for reading this far. If you could like and share, I would be very grateful. If you didn't like it, I can't know if you liked the post. This way, you help me know where I should improve my posts. Thank you.

---

My Latest Posts

Did you say Free GPU?

sc0v0ne ・ Feb 29

#python #gpu #ai #machinelearning

My Super Powers as a Software Developer - 2024

sc0v0ne ・ Jan 6

#tools #softwaredevelopment #workstations #productivity

Becoming Efficient with Pomodoro

sc0v0ne ・ Feb 12

#tools #productivity #softwaredevelopment

---

Favorites Projects Open Source

• ? Python
• ?️ Deep Learning
• ? Computer Vision
• ?️ Linux
• ? Times Series
• ? Database
• ? Rust
• ?️ Machine Learning
• ?️ Roadmaps

---

About the author:

sc0v0neFollow

This blog is to create some posts about subjects that I am studying and I share them to help other users.

A little more about me...

Graduated in Bachelor of Information Systems, in college I had contact with different technologies. Along the way, I took the Artificial Intelligence course, where I had my first contact with machine learning and Python. From this it became my passion to learn about this area. Today I work with machine learning and deep learning developing communication software. Along the way, I created a blog where I create some posts about subjects that I am studying and share them to help other users.

I'm currently learning TensorFlow and Computer Vision

Curiosity: I love coffee

• Kaggle
• Gitlab
• Github
• Mastodon

The above is the detailed content of Ollama - Custom Model - llama. For more information, please follow other related articles on the PHP Chinese website!