LocoGPT

LocoGPT LLM is a fun and innovative app that lets you chat offline with an AI agent that uses a large language model (LLM) of your choice. You can have a casual conversation, ask a question, or request some imaginative and innovative content such as poems, stories, code, essays, songs, celebrity parodies, and more. The AI agent can understand and communicate fluently in your language of choice, using its own words and knowledge.

## Features

- Offline chat session that uses a large language model (LLM) of your choice

- Choose from three different chat modes and configurations: Balanced, Creative, and Precise, or customize to suit your mood and preference

- Ask the LLM to generate imaginative and innovative content such as poems, stories, code, essays, songs, celebrity parodies, and more using its own words and knowledge

- Request the LLM to help you with writing, rewriting, improving, or optimizing your content

- Customize inference and model parameters to fine-tune the output and performance of the app for example Temperature, TopP, TopK, RepeatPenalty, MaxTokens, RepeatLastTokensCount, Prompt Template, Anti Prompts

- Choose your models folder from your computer

- Able to customize prompt template and anti-prompts

- Customize the app’s appearance with Mica, Mica Alt, Acrylic, or Dynamic Shader Animation backgrounds

## Models

You can browse and download pre-selected LLMs or bring your own .gguf model file. The app supports gguf file format and can run LLM models well even without GPU or not enough GPU memory. The app also supports Nvidia Cuda 11 and 12 GPU and AVX2 CPU.