🧠 Agentic Long-Term Memory with Notion Integration

This project explores the concept of long-term memory in AI agents and demonstrates how to build sophisticated agentic memory systems using various approaches and tools. Now featuring complete Notion workspace integration and MCP (Model Context Protocol) implementation!

Feel free to ⭐️ the repo if it helps you understand long-term memory for agents!

🚀 What's New - Enhanced Features

🔥 Complete Notion Integration

• 15+ Notion Functions: Search, read, create, update, and analyze your Notion workspace
• Smart Content Management: Add paragraphs, headings, bullets, todos with intelligent formatting
• Advanced Content Types: Bookmarks and internal page links with URL validation
• Workspace Analytics: Get insights about your Notion usage patterns
• Bulk Operations: Handle multiple pages and operations efficiently with smart pagination
• Function Chaining: Complex multi-step workflows handled automatically
• Production-Ready MCP Server: Complete Notion MCP Server V2.1 with bulletproof validation and comprehensive testing

🎯 MCP (Model Context Protocol) Implementation

• Multiple Transport Support: HTTP and stdio transport protocols
• Production Ready: Deployable MCP servers with fallback strategies
• Tool Discovery: Automatic tool registration and discovery
• Error Handling: Comprehensive error management and recovery

📚 Comprehensive Documentation

📖 Core Documentation

• 🤖 Complete System Explanation - Detailed walkthrough of the entire chatbot system
• 🔧 How MCP Tools Work - Deep dive into MCP implementation and tool mechanics
• 🚀 Notion Integration Guide - Complete Notion ServerV2 integration documentation
• 🔗 Notion MCP Server - Complete Notion MCP Server V2.1 - Production-ready server with bulletproof validation

🔍 Implementation Guides

• 📊 MCP Implementation Comparison - Comparison of different MCP implementation approaches
• 🎯 MCP Notion README - Specific MCP Notion integration setup and usage
• ⚙️ Production Configuration - Production deployment and configuration guide

🧠 Memory System Research

• Memory in LLM Agents - Research paper reference
• MemGPT Paper - PDF available in the repo

📚 What You'll Learn

1. How to design a custom agentic long-term memory system
2. How to implement long-term memory using Vector DB and Graph DB with LangChain and LangGraph
3. How to structure memory into semantic, episodic, and procedural components
4. Complete Notion workspace integration with natural language processing
5. MCP (Model Context Protocol) implementation for scalable tool integration
6. Production-ready MCP server development - see our Notion MCP Server V2.1
7. Advanced function chaining for complex multi-step workflows
8. Production-ready deployment strategies and configurations

💾 How to Run the Project

⚠️ Note: Please use Python 3.11 as Python 3.12 may cause compatibility issues with some dependencies.

1. Environment Setup

# Create virtual environment
python -m venv venv
source venv/bin/activate  # or venv\Scripts\activate on Windows

# Install dependencies
pip install -r requirements.txt

2. Database Preparation

# Setup SQLite DB
python src/prepare_sqldb.py

# Setup Vector DB
python src/prepare_vectordb.py

# Verify databases
python src/check_sqldb.py
python src/check_vectordb.py

3. Environment Variables

# Required
export OPENAI_API_KEY="your_openai_api_key"
export NOTION_TOKEN="your_notion_integration_token"

# Optional
export NOTION_API_KEY="your_notion_integration_token"  # Alternative to NOTION_TOKEN

4. Run the Enhanced Chatbot

# Terminal version with full Notion integration
python src/chat_in_terminal.py

# Gradio UI version
python src/chat_in_ui.py

5. Test the Integration

# Test Notion integration
python test_notion_integration.py

# Test MCP functionality
python test_notion_mcp.py

🎯 Available Chatbot Versions

Version 1: Basic Chatbot (basic_chatbot_v1.py)

• Simple conversation handling
• Basic OpenAI integration

Version 2: Agentic Chatbot (chatbot_agentic_v2.py)

• Function calling capabilities
• User information management
• Chat history search

Version 3: Enhanced Agentic Chatbot (chatbot_agentic_v3.py) - ⭐ MAIN VERSION

• Complete Notion integration (15+ functions)
• Advanced memory systems (Vector DB + SQL)
• Smart function chaining
• Production-ready architecture
• MCP protocol support

🔧 Key Features

🧠 Memory Systems

• SQL Database: Structured user information and chat history
• Vector Database: Semantic search through conversation history
• Smart Summarization: Automatic conversation summarization
• Context Management: Intelligent context preservation

🔗 Notion Integration

• Search & Discovery: Full-text search across pages and databases
• Content Management: Create, read, update pages with rich formatting
• Advanced Content Types: Bookmarks and internal page links with validation
• Analytics: Workspace insights and usage patterns
• Bulk Operations: Handle multiple operations efficiently
• Production MCP Server: Complete V2.1 Server with bulletproof validation and 48KB test suite

🎯 Function Chaining

• Multi-step Workflows: Automatic handling of complex tasks
• Context Awareness: Understanding when tasks require multiple steps
• Smart Routing: Intelligent function selection and execution

⚙️ Production Features

• Error Handling: Comprehensive error management
• Fallback Systems: Multiple backup strategies
• Scalable Architecture: Easy to extend and modify
• MCP Protocol: Standard tool integration protocol

🏗️ Project Architecture

┌─────────────────────┐    ┌─────────────────────┐    ┌─────────────────────┐
│   User Interface    │───▶│  Chatbot Agentic V3  │───▶│  External Systems   │
│   (Terminal/UI)     │    │  (Main Controller)   │    │  (Notion, DB, etc)  │
└─────────────────────┘    └─────────────────────┘    └─────────────────────┘
                                      │
                                      ▼
                      ┌─────────────────────────────────────────┐
                      │           Core Components               │
                      │  ┌─────────────┐  ┌─────────────────┐  │
                      │  │   OpenAI    │  │   Notion        │  │
                      │  │   Agent     │  │   ServerV2      │  │
                      │  └─────────────┘  └─────────────────┘  │
                      │  ┌─────────────┐  ┌─────────────────┐  │
                      │  │   Memory    │  │   Vector DB     │  │
                      │  │   Systems   │  │   (Embeddings)  │  │
                      │  └─────────────┘  └─────────────────┘  │
                      │  ┌─────────────┐  ┌─────────────────┐  │
                      │  │     MCP     │  │   SQL Database  │  │
                      │  │   Protocol  │  │   (Structured)  │  │
                      │  └─────────────┘  └─────────────────┘  │
                      └─────────────────────────────────────────┘

📂 Updated Project Structure

src/
├── chat_in_terminal.py        # Enhanced terminal chatbot
├── chat_in_ui.py              # Gradio UI version
├── prepare_sqldb.py           # Creates SQLite DB
├── prepare_vectordb.py        # Creates Vector DB
├── check_sqldb.py             # Checks SQLite DB contents
├── check_vectordb.py          # Checks Vector DB contents
├── notion_mcp_server/         # 🆕 Complete Notion MCP Server
│   ├── core_operations.py     # Basic Notion operations
│   ├── analytics_operations.py # Workspace analytics
│   ├── bulk_operations.py     # Bulk operations
│   ├── update_operations.py   # Content updates
│   ├── notion_utils.py        # Utility functions
│   ├── api_serverV2.py        # HTTP API server
│   ├── serverV2.py            # MCP server implementation
│   ├── test_server.py         # 🆕 48KB comprehensive test suite
│   └── README.md              # 🆕 Complete MCP Server V2.1 documentation
└── utils/
    ├── basic_chatbot_v1.py    # Basic chatbot implementation
    ├── chatbot_agentic_v2.py  # Agentic chatbot v2
    ├── chatbot_agentic_v3.py  # 🆕 Main enhanced chatbot (LATEST)
    ├── mcp_client_manager.py  # 🆕 MCP client management
    ├── chat_history_manager.py
    ├── vector_db_manager.py
    ├── user_manager.py
    ├── prepare_system_prompt.py
    ├── search_manager.py
    ├── sql_manager.py
    ├── config.py
    └── utils.py

# Testing Files
├── test_notion_integration.py  # 🆕 Notion integration tests
├── test_notion_mcp.py          # 🆕 MCP functionality tests
├── test_chatbot_integration.py # 🆕 Chatbot integration tests
└── [other test files...]

# Documentation
├── HOW_MCP_TOOLS_WORK.md      # 🆕 MCP implementation guide
├── NOTION_INTEGRATION_README.md # 🆕 Notion integration docs
├── MCP_IMPLEMENTATION_COMPARISON.md # 🆕 Implementation comparison
├── MCP_NOTION_README.md       # 🆕 MCP Notion setup guide
├── PRODUCTION_CONFIG.md       # 🆕 Production deployment
└── README.md                  # This file