AgentSkillsCN

oxylabs-web-unblocker

借助 Oxylabs Web Unblocker（一款基于人工智能的代理工具），轻松绕过反机器人防护措施。该代理可自动处理指纹识别、JavaScript 渲染，并支持自动重试。适用于用户需要爬取受保护网站、绕过验证码、访问被屏蔽的内容，或在常规代理因反机器人策略而失效时使用。

SKILL.md
--- frontmatter
name: oxylabs-web-unblocker
description: Bypasses anti-bot protections using Oxylabs Web Unblocker, an AI-powered proxy that handles fingerprinting, JavaScript rendering, and retries automatically. Use when the user needs to scrape protected websites, bypass CAPTCHAs, access blocked content, or when regular proxies fail due to anti-bot measures.

Oxylabs Web Unblocker

AI-powered proxy solution that automatically manages fingerprinting, headers, retries, and JavaScript rendering.

Endpoint

code
https://unblock.oxylabs.io:60000

Authentication

HTTP Basic Auth via proxy credentials:

bash
curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  "https://example.com"

Quick Start

Basic request:

bash
curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  "https://ip.oxylabs.io/headers"

With JavaScript rendering:

bash
curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "x-oxylabs-render: html" \
  "https://example.com/spa-page"

Headers

HeaderDescription
x-oxylabs-renderhtml for rendered HTML, png for screenshot
X-Oxylabs-Session-IdReuse same IP across requests (any random string)
X-Oxylabs-Geo-LocationTarget country (e.g., Germany, United States)
x-oxylabs-force-headers: 1Enable custom header passthrough
X-Oxylabs-Successful-Status-CodesDefine custom success codes to prevent retries

Session Persistence

Reuse the same IP across multiple requests:

bash
curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "X-Oxylabs-Session-Id: my-session-123" \
  "https://example.com/page1"

Geo-Location Targeting

bash
curl -k -x "https://unblock.oxylabs.io:60000" \
  -U "$OXYLABS_USERNAME:$OXYLABS_PASSWORD" \
  -H "X-Oxylabs-Geo-Location: Germany" \
  "https://example.com"

When to Use Web Unblocker vs Regular Proxies

ScenarioUse
Sites with anti-bot protectionWeb Unblocker
CAPTCHAs, fingerprint detectionWeb Unblocker
JavaScript-heavy SPAsWeb Unblocker with x-oxylabs-render: html
Simple requests, no protectionRegular Proxies
High volume, price sensitiveRegular Proxies

Key Guidelines

  • •Always use -k flag (or disable SSL verification) - the proxy uses its own certificates
  • •Add x-oxylabs-render: html if experiencing empty content or low success rates
  • •Avoid adding custom unblocking headers that may interfere with the AI

For code examples in Python, Node.js, PHP, Go, Java, and C#, see examples.md.