goesByhc/cn-scraper-mcp

What it does

cn-scraper-mcp is an MCP (Model Context Protocol) server that provides AI agents with the ability to search, browse, and extract data from major Chinese internet platforms. It supports integration with platforms including Taobao, JD.com, Xiaohongshu, Zhihu, Weibo, Bilibili, ZSXQ, Douban, and Dianping. The tool handles authentication and session management through local-first cookie storage and CDP-assisted login capabilities.

How to set up

Installation requires Python and involves configuring the MCP server to connect with your AI agent. Setup includes: (1) cloning the repository, (2) installing Python dependencies, (3) configuring local cookie storage for authentication, (4) enabling CDP (Chrome DevTools Protocol) for automated login assistance, (5) integrating with your preferred AI platform that supports MCP protocol.

Key features

• Multi-platform support for 8+ major Chinese e-commerce and social platforms
• Local-first cookie storage for secure session management
• CDP-assisted automated login without storing credentials
• Data extraction and search capabilities across platforms
• MCP server architecture for seamless AI agent integration
• Support for chatGPT, Claude, and other MCP-compatible AI tools