Welcome to SpiderIQ

Welcome to SpiderIQ API

SpiderIQ is a scalable, distributed web scraping platform with AI-powered lead generation, built on modern infrastructure with Database and FastAPI.

What is SpiderIQ?

SpiderIQ provides eight powerful engines:

Intelligent website crawling with AI-powered lead extraction and CHAMP scoring

Google Maps business discovery with contact info and bulk search

Deep place enrichment with reviews, photos, and sentiment analysis

SMTP-level email verification without sending actual emails

LinkedIn profile research with natural language search and AI insights

Landing page capture with screenshots, HTML bundles, and AI content extraction

Full-text search with faceted filtering and geo-radius queries across all indexed job results

Anti-detect browser profile management with VNC access for authenticated sessions and cookie export

Secure email infrastructure for AI agents — send, receive, and manage emails with built-in prompt injection protection and credential leak prevention

Build & Deploy with AI Agents

AI-native site builder — build, deploy, and personalize websites with AI agents. Starter kit on GitHub.

Headless CMS with pages, posts, docs, navigation, Liquid templates, and Shadow DOM components. Deploy to Cloudflare edge in 2-5 seconds.

Unified read API over your CRM data — businesses, contacts, emails, phones. Powers dynamic landing pages with lead personalization.

Personalize landing pages per lead using CRM data. Each visitor sees their business name, city, and rating — automatically from a Google Place ID in the URL.

Get SpiderPublish (2026-04-15)

Install the CLI + MCP for any Claude Code / Cursor / Windsurf / Antigravity project:

# 1. Install the CLI (pulls the latest 0.8.x)
npx @spideriq/cli@latest --version --registry https://npm.spideriq.ai
# → 0.8.0 (or later)

# 2. Pull the starter kit (.mcp.json + CLAUDE.md + spideriq.json.example)
npx degit martinshein/SpideriQ-ai/SpiderPublish my-site
cd my-site

# 3. Authenticate (one-time, sends approval email to admin)
npx @spideriq/cli auth request --email admin@company.com --registry https://npm.spideriq.ai

# 4. Bind THIS directory to a project (writes spideriq.json — commit it)
npx @spideriq/cli use <project> --registry https://npm.spideriq.ai

Restart your IDE after step 2. The MCP server loads 152+ tools automatically.

Multi-Tenant Safety (Phase 11+12 — new 2026-04-14)

If you run AI agents across multiple client projects, the new hardened flow makes cross-tenant writes structurally impossible. Five independent tenant checks run on every dashboard call — break any one, the request 403s before any mutation.

One folder, one project, one spideriq.json. Two Antigravity windows can't cross-wire. Run spideriq use <project> once per directory.

Destructive operations (publish, delete, deploy, apply theme) are two-step: dry_run=true returns a preview + confirm_token, second call consumes it. No accidental production writes.

Migration window: legacy unscoped URLs still work until Sunset: 2026-05-14. All responses from legacy paths now carry Deprecation: true + Link: rel="successor-version" headers. Upgrade to @spideriq/cli@0.8.0+ / @spideriq/mcp@0.8.0+ to pick up the new flow automatically.

Key Features

70 SpiderSite + 42 SpiderMaps + 13 SpiderVerify + 1 SpiderPeople + 1 SpiderMapsEnrich + 1 SpiderLanding workers across 10 VPS

5-60 seconds per URL depending on complexity

Team extraction, company vitals, pain points, CHAMP scoring

Per-client data deduplication with unique record marking

Architecture

User → HTTPS → API Gateway → Message Queue
                                  ↓
                    112 Distributed Workers
                                  ↓
                Database + Cloudflare R2

Quick Links

Get started in 5 minutes

Complete API documentation

Learn how to authenticate

Version Info

API Version: 1.0.0
Current Release: v2.32.0
Base URL: https://spideriq.ai
OpenAPI Spec: /api/v1/openapi.json

Need Help?

View real-time system health

Get help from our team

Welcome to SpiderIQ