Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform; this toolkit enables scraping, searching, and structured data extraction from any site at scale without being blocked.
Capabilities
- Web scraping: Fetch any webpage and return its content as clean Markdown.
- Multi-engine search: Query Google, Bing, or Yandex with controls for result count, search type (web/images), and country targeting.
- Structured data feeds: Extract typed JSON records from 20+ source types across Amazon, LinkedIn, Instagram, Facebook, X, YouTube, Zillow, Booking.com, and ZoomInfo — no custom parsing required.
Secrets
Both secrets are required to authenticate requests to Bright Data.
-
BRIGHTDATA_API_KEY— Your Bright Data API key. Obtain it from the Bright Data control panel under Account Settings → API Token. A paid or trial Bright Data account is required; the key grants programmatic access to all Bright Data services. -
BRIGHTDATA_ZONE— The name of a Bright Data proxy/scraping zone. Zones are created in the Bright Data control panel under Proxies & Scraping Infrastructure. Each zone defines the proxy type (e.g., datacenter, residential, Web Unlocker) and its configuration. Create or select an existing zone and copy its exact zone name (not the zone ID) into this secret.
For help configuring secrets in Arcade, see the Arcade secrets guide. You can also manage secrets directly at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |