GenAI Chatbot

A Generative AI chatbot built using Meta LLaMA 2 7B, LangChain, and Gradio that enables conversational AI interactions through a clean web interface.

Features

• LLM inference using Meta LLaMA 2 7B Chat
• Conversational memory using LangChain
• Interactive chat interface using Gradio
• CPU and GPU compatible

Tech Stack

• Python
• meta-llama/Llama-2-7b-chat-hf
• Hugging Face Transformers
• LangChain
• Gradio

Installation

1. Clone the repository git clone https://github.com/avanthikasreejith8923-a11y/gen-ai-chatbot.git cd gen-ai-chatbot

2. Create virtual environment python -m venv venv venv\Scripts\activate

3. Install dependencies pip install torch transformers gradio langchain langchain-community accelerate

4. Add your HuggingFace token in app.py token = "your_hf_token_here"

5. Run the app python app.py

Usage

• Open the Gradio link shown in terminal
• Type your message and press Enter
• The chatbot will respond using LLaMA 2 7B

Requirements

• HuggingFace account with access to meta-llama/Llama-2-7b-chat-hf
• Minimum 16GB RAM recommended
• GPU recommended for faster inference