Indeed Scraper

Description

The Indeed Scraper API allows you to extract detailed company information and job listings from Indeed.com. This powerful tool enables developers to integrate Indeed data into their applications, conduct market research, or monitor trends across various companies and job markets.

How to Use

To use the Indeed Scraper API, you'll need to authenticate your requests using your API key. The API provides several endpoints for retrieving different types of information:

Endpoints

• POST https://taskagi.net/api/b2b/indeed-scraper/companies - Retrieve company information by URL
• POST https://taskagi.net/api/b2b/indeed-scraper/companies-by-company-list - Discover companies by a list of company names
• POST https://taskagi.net/api/b2b/indeed-scraper/companies-by-industry-and-state - Discover companies by industry and state
• POST https://taskagi.net/api/b2b/indeed-scraper/companies-by-keyword - Discover companies by keyword
• POST https://taskagi.net/api/b2b/indeed-scraper/job-listings - Retrieve job listings by URL
• POST https://taskagi.net/api/b2b/indeed-scraper/job-listings-by-keyword - Discover job listings by keyword
• POST https://taskagi.net/api/b2b/indeed-scraper/job-listings-by-company-url - Retrieve job listings by company URL

Authentication

Include your API key in the request headers:

Authorization: Bearer YOUR_API_KEY

Request Body

The request body should be a JSON object with the following structure, depending on the endpoint:

// For companies endpoint
{
    "url": "https://www.indeed.com/cmp/Company-Name"
}

// For companies-by-company-list endpoint
{
    "companies": ["Company1", "Company2", "Company3"]
}

// For companies-by-industry-and-state endpoint
{
    "industry": "Technology",
    "state": "California"
}

// For companies-by-keyword and job-listings-by-keyword endpoints
{
    "keyword": "software engineer"
}

// For job-listings endpoint
{
    "url": "https://www.indeed.com/jobs?q=software+engineer&l=San+Francisco%2C+CA"
}

// For job-listings-by-company-url endpoint
{
    "url": "https://www.indeed.com/cmp/Company-Name/jobs"
}

Rate Limiting

Please note that usage is subject to rate limiting. Refer to your plan details for specific limits.

import requests
import json

# Your API Key
api_key = 'YOUR_API_KEY'

# API Endpoint for company information
url = 'https://taskagi.net/api/b2b/indeed-scraper/companies'

# Headers
headers = {
    'Authorization': f'Bearer {api_key}',
    'Content-Type': 'application/json'
}

# Request Body
data = {
    'url': 'https://www.indeed.com/cmp/Example-Company'
}

# Send POST request
response = requests.post(url, headers=headers, json=data)

# Check if the request was successful
if response.status_code == 200:
    # Parse the JSON response
    company_data = response.json()
    
    # Print the company information
    print(json.dumps(company_data, indent=2))
else:
    print(f"Error: {response.status_code}")
    print(response.text)

# Example for job listings by keyword
url = 'https://taskagi.net/api/b2b/indeed-scraper/job-listings-by-keyword'

data = {
    'keyword': 'software engineer'
}

response = requests.post(url, headers=headers, json=data)

if response.status_code == 200:
    job_listings = response.json()
    print(json.dumps(job_listings, indent=2))
else:
    print(f"Error: {response.status_code}")
    print(response.text)