Skip to content

Rehan000/MultiGPT

Repository files navigation

MultiGPT: Chatbot with Audiochat, Image and PDF Capabilities

image.png

Introduction

MultiGPT is a chatbot designed to run locally on the machine without any API calls to hosted models. All required models are hosted and run locally on the user machine. MultiGPT offers chat with support to save and load chat sessions, upload and analyze audio file, upload and analyze image files and upload and analyze PDF files for specific user queries in those documents. MultiGPT also supports audio-chat, where the user can ask a question into a microphone.

Features

✅ Chatbot with Mistral-7B LLM model.
✅ Image analysis support using Llava model.
✅ Audio-chat support using OpenAI whisper model.
✅ Analysis of audio files. (MP3, WAV, OGG)
✅ RAG (Retrieval-Augmented Generation) implemented to support user queries from PDF documents.
✅ Save chat sessions with date and time to enable resumption of chat.
✅ Intuitive user interface (UI), using streamlit.

Installation

We recommend using Conda, but you can use any virtual environment of your choice. If you use Conda, create a new environment with:

conda create -n multigptenv python=3.11
conda activate multigptenv
pip install -r requirements.txt

Usage

Run the following command to start the MultiGPT UI in a browser:

streamlit run app.py

About

GPT chatbot with file upload, image and audiochat capabilities

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages