JobSpy Rate Limit (HTTP 429) Fix & Production Alternative: Unified ATS JSON API

1. Why python-jobspy Hits HTTP 429 Too Many Requests & Cloud IP Bans

Developers deploying jobspy.scrape_jobs() into scheduled Airflow/GitHub Actions pipelines, FastAPI backends, or AI recruiting agents consistently run into three infrastructure walls:

• LinkedIn Guest Endpoint Throttling & N+1 Description Amplification: JobSpy scrapes LinkedIn's unauthenticated /jobs-guest/jobs/api/seeMoreJobPostings/search HTML endpoint, which enforces aggressive per-IP sliding-window rate limits (HTTP 429 / status 999). Setting linkedin_fetch_description=True fires an extra HTTP GET per job posting to extract full text and compensation — turning a 100-job batch into 104 rapid requests.
• Datacenter ASN & TLS Fingerprint Blocks on Indeed / Glassdoor: Cloudflare Bot Management and TLS/JA3 fingerprinting block standard Python requests/tls-client traffic originating from AWS, GCP, Azure, DigitalOcean, Hetzner, and GitHub Actions runners — forcing teams to buy rotating residential proxy bandwidth ($5–$12/GB).
• Missing Canonical Company Domains & Redirect-Wrapped Apply Links: Job board HTML cards frequently strip employer domains, mask original ATS URLs behind tracking redirects, and silently return empty DataFrames whenever upstream CSS classes or GraphQL query hashes rotate.

2. 5-Minute Python Migration: Replace scrape_jobs() with pandas-Ready ATS JSON

Drop out rotating proxy URLs, sleep jitter, and 429 retry loops. The function below returns a clean pandas DataFrame matching JobSpy's familiar columns while adding canonical employer domains, normalized USD compensation, and extracted technical skills:

curl -sG "https://api.jobpostingsapi.com/v1/jobs/search" \
  -H "x-api-key: jp_live_your_api_key" \
  --data-urlencode "q=backend engineer" \
  --data-urlencode "country=US" \
  --data-urlencode "work_arrangement=remote" \
  --data-urlencode "limit=50"

{
  "code": 0,
  "status": "ok",
  "meta": {
    "request_id": "d1c0b11c-f35c-40cb-87f3-361e394a0dc3",
    "count": 1,
    "total": 507,
    "total_relation": "eq",
    "has_more": true,
    "next_cursor": "eyJrIjoibG9jYWwiLCJvIjoyfQ",
    "took_ms": 123,
    "redistribution_filter": "redistributable_only"
  },
  "data": [
    {
      "id": "j_n4p2mfqrxjlhyw7w",
      "data_tier": "premium",
      "status": "active",
      "title": "Senior Backend Engineer - Backend",
      "company": {
        "id": "c_x5lqv2wtrcdok",
        "name": "Dragos",
        "slug": "dragos",
        "domain": "dragos.com",
        "is_staffing_agency": false,
        "industry": "software_it"
      },
      "department": "Backend Development",
      "location": {
        "raw": "United States",
        "country": "US"
      },
      "work_arrangement": "remote",
      "employment_type": "full_time",
      "seniority": "senior",
      "experience_years_min": 5,
      "job_function": "engineering",
      "skills": [
        "cybersecurity",
        "rust",
        "docker",
        "kotlin",
        "postgresql",
        "terraform",
        "microservices",
        "python",
        "kubernetes",
        "distributed systems"
      ],
      "salary": {
        "min": 165000,
        "max": 165000,
        "currency": "USD",
        "period": "year",
        "annual_usd_min": 165000,
        "annual_usd_max": 165000
      },
      "url": "https://job-boards.greenhouse.io/dragos/jobs/5364834008",
      "apply_url": "https://job-boards.greenhouse.io/dragos/jobs/5364834008",
      "source": {
        "name": "greenhouse",
        "display_name": "Greenhouse",
        "type": "ats",
        "board": "dragos",
        "job_id": "5364834008"
      },
      "redistribution_allowed": true,
      "posted_at": "2026-07-21T01:17:03.000Z"
    }
  ]
}

3. Give Claude, ChatGPT & Coding Agents Live Job Search via Remote MCP (https://mcp.jobpostingsapi.com/v1/mcp)

Wrapping python-jobspy inside an MCP tool or cloud AI agent fails immediately because Anthropic, OpenAI, Modal, and cloud container egress IPs are blocked by LinkedIn and Cloudflare. Use our hosted MCP endpoints instead:

• 1-Click OAuth 2.1 Remote MCP (Claude Web & ChatGPT Connectors): Point Claude.ai or ChatGPT Connectors to https://mcp.jobpostingsapi.com/v1/mcp. Browser-based OAuth 2.1 PKCE authenticates in one click, mints 1,500 Free Credits automatically, and exposes search_jobs, get_company_jobs, get_job_detail, and detect_company_ats with zero 429 errors.
• API-Key HTTP MCP & Local Stdio Package: For Cursor, Windsurf, Claude Code, or automated agent frameworks, connect directly to https://api.jobpostingsapi.com/mcp with Authorization: Bearer jp_live_... or run npx -y @jobpostingsapi/mcp-server.
• Free Browser Utilities Before Writing Code: Inspect live Greenhouse/Lever/Ashby JSON payloads at /tools/greenhouse-lever-job-json-viewer or detect any company's underlying ATS slug for free at /tools/ats-detector.