Skip to content

A Minimum Control Program (MCP) server implementation for web browsing capabilities using BeautifulSoup4

License

Notifications You must be signed in to change notification settings

blazickjp/web-browser-mcp-server

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🌐 Web Browser MCP Server

PyPI version License: MIT Python Code style: black

🤖 Transform your AI applications with powerful web browsing capabilities! Let your AI read and understand the web.

✨ Features

  • 🎯 Smart Content Extraction - Target exactly what you need with CSS selectors
  • Lightning Fast - Built with async processing for optimal performance
  • 📊 Rich Metadata - Capture titles, links, and structured content
  • 🛡️ Robust & Reliable - Built-in error handling and timeout management
  • 🌍 Cross-Platform - Works everywhere Python runs

🚀 Quick Start

Installation

Choose your favorite package manager:

# Using pip
pip install web-browser-mcp-server

# Using uv (recommended)
uv pip install web-browser-mcp-server

🔌 Claude Desktop Integration

Add this to your Claude Desktop config to unlock web browsing superpowers:

📝 Click to view configuration
{
    "mcpServers": {
        "web-browser-mcp-server": {
            "command": "uv",
            "args": [
                "--directory",
                "/path/to/web-browser-mcp-server",
                "run",
                "web-browser-mcp-server"
            ],
            "env": {
                "REQUEST_TIMEOUT": "30"
            }
        }
    }
}

💡 Replace /path/to/web-browser-mcp-server with your installation path

🎮 Usage Examples

Extract exactly what you need from any webpage:

# Basic webpage fetch
result = browse_webpage(url="https://example.com")

# Target specific content with CSS selectors
result = browse_webpage(
    url="https://example.com",
    selectors={
        "headlines": "h1, h2",
        "main_content": "article.content",
        "navigation": "nav a"
    }
)

⚙️ Configuration

Customize behavior with environment variables:

Variable Description Default
REQUEST_TIMEOUT ⏱️ Max request time (seconds) 30
USER_AGENT 🕵️ Custom user agent string Modern Chrome UA
LOG_LEVEL 📝 Logging verbosity "info"
MAX_RETRIES 🔄 Max retry attempts 3

🛠️ Development

Set up your dev environment in seconds:

# Create and activate virtual environment
uv venv
source .venv/bin/activate

# Install dev dependencies
uv pip install -e ".[test]"

# Run tests
python -m pytest

🤝 Contributing

Contributions are welcome! Feel free to:

  • 🐛 Report bugs
  • 💡 Suggest features
  • 🔧 Submit pull requests

📜 License

MIT License - do what you want! See LICENSE for details.


🌟 Level Up Your AI with Web Browsing Powers! 🌟

Built for the Model Context Protocol | Made with ❤️ by the MCP Community

🎉 Star us on GitHub!
If you find this tool useful, consider giving it a star! It helps others discover the project.

About

A Minimum Control Program (MCP) server implementation for web browsing capabilities using BeautifulSoup4

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages