Web Crawler MCP

Search

MCP server for web crawling and news extraction — browse the web, extract articles, and process news feeds.

GitHub

Quick Install 

uvx web-crawler-mcp-server

One-click install

Install in Cursor Install in VS Code
More clients (VS Code Insiders, Antigravity, Windsurf, Zed, Trae…)
VS Code Insiders

JSON works with: Antigravity (Google), Windsurf (Codeium), Trae (ByteDance), Zed, Continue.dev, Cline, Roo Code, and any other MCP-compatible client. Paste into their MCP config file or settings.

Manual configuration

Add this to your Claude Code settings.json (or .claude/settings.json in your project): 

{
  "mcpServers": {
    "web-crawler-mcp": {
      "command": "uvx",
      "args": [
        "web-crawler-mcp-server"
      ]
    }
  }
}

Looking for the right MCP server?

Answer a few questions — get an AI-picked shortlist of MCP servers that match your IDE and stack.

Open AI Tool Finder