.. DataVerse Chatbot documentation master file

DataVerse Chatbot Documentation
===============================

**DataVerse ChatBot** is a powerful Python-based application that enables real-time, AI-driven chat interactions by extracting and processing data from virtually any source—web pages, nearly all file formats, and more. 

The system combines advanced web crawling, multi-format data extraction, and Retrieval-Augmented Generation (RAG) techniques, integrating with leading Large Language Models (LLMs) to deliver context-aware responses.

.. toctree::
   :maxdepth: 2
   :caption: Contents:

   overview
   installation
   usage
   modules/chatbot
   modules/web
   modules/bots
   api_reference
   examples

Key Features
------------

- **Web Crawling**: Extracts content from specified web sources with customizable parameters
- **Multi-Format Data Extraction**: Processes data from PDFs, text files, documents, spreadsheets, and more
- **Monitoring and Uncertainty Detection**: Tracks responses and uses trained classifiers to detect uncertain answers
- **LLM Integration**: Works with multiple leading models (OpenAI, Claude, Cohere, DeepSeek, Gemini, Grok, Mistral)
- **Multiple Chat Interfaces**: Deployable as WhatsApp and Telegram bots or embedded via an iframe

Indices and tables
==================

* :ref:`genindex`
* :ref:`modindex`
* :ref:`search`