The LinkedIn Scraper is a cutting-edge tool designed to extract and organize content from the world's largest professional networking platform. This powerful scraper offers an efficient method to collect profiles, job postings, company information, and professional connections, providing valuable insights for various industries and applications.
Data Point | Description | Example |
---|---|---|
Profile Information | Detailed user data | Name, position, location, about section |
Professional Experience | Career history | Company names, job titles, durations |
Education | Academic background | Institutions, degrees, fields of study |
Skills & Endorsements | Professional capabilities | Listed skills, number of endorsements |
Connections | Network size | Number of connections, mutual connections |
Job Postings | Detailed job information | Job title, company, location, description |
Company Profiles | Organizational details | Company size, industry, about section |
The LinkedIn Scraper is a valuable asset for various sectors, including:
The LinkedIn Scraper API allows you to extract various types of information from LinkedIn, including company profiles, people profiles, posts, and job listings. This powerful tool enables developers to integrate LinkedIn data into their applications for market research, lead generation, competitive analysis, and more.
To use the LinkedIn Scraper API, you'll need to authenticate your requests using your API key. The API provides several endpoints for retrieving different types of information:
Include your API key in the request headers:
Authorization: Bearer YOUR_API_KEY
The request body should be a JSON object with the following structure, depending on the endpoint:
// For URL-based endpoints (companies, profiles, posts, jobs)
{
"url": "https://www.linkedin.com/company/company-name"
}
// For profiles-by-name endpoint
{
"name": "John Doe"
}
// For jobs-by-keyword endpoint
{
"keyword": "software engineer"
}
Please note that usage is subject to rate limiting. Refer to your plan details for specific limits.
Here's an example of the data you can expect to receive for the companies endpoint:
[
{
"input": {
"url": "https://il.linkedin.com/company/ibm"
},
"id": "ibm",
"name": "IBM",
"country_code": "US,ZA,UY,TH,ID,AU,CZ,SG,IT,DE,MY,FI,CO,RU,AE,FR,SK,KW,IN,BR,GR,MX,ES,AR,RO,EG",
"locations": [
"International Business Machines Corp. New Orchard Road Armonk, New York, NY 10504, US",
"590 Madison Ave New York, NY 10022, US",
// ... more locations
],
"followers": 17226208,
"employees_in_linkedin": 314873,
"about": "At IBM, we do more than work. We create. We create as technologists, developers, and engineers. We create with our partners. We create with our competitors. If you're searching for ways to make the world work better through technology and infrastructure, software and consulting, then we want to work with you. We're here to help every creator turn their \"what if\" into what is. Let's create something that will change everything.",
"specialties": "Cloud, Mobile, Cognitive, Security, Research, Watson, Analytics, Consulting, Commerce, Experience Design, Internet of Things, Technology support, Industry solutions, Systems services, Resiliency services, Financing, and IT infrastructure",
"company_size": "10,001+ employees",
"organization_type": "Public Company",
"industries": "IT Services and IT Consulting",
"website": "https://www.ibm.com/",
"company_id": "1009",
"employees": [
{
"img": "https://media.licdn.com/dms/image/v2/D5603AQG8BrSbmTF3KQ/profile-displayphoto-shrink_100_100/profile-displayphoto-shrink_100_100/0/1698961770751?e=2147483647&v=beta&t=NIr8LzS3QQoK-FqwJ8V1ZzW9hFdKDjqxi_x5cMxMSS4",
"link": "https://www.linkedin.com/in/dnielsen?trk=org-employees",
"subtitle": "Developer Relations Professional with a Passion for Community",
"title": "Dave Nielsen"
},
// ... more employees
],
"headquarters": "Armonk, New York, NY",
"image": "https://media.licdn.com/dms/image/v2/D4E3DAQF5TKSpwbN1sQ/image-scale_127_750/image-scale_127_750/0/1719333169994/ibm_cover?e=2147483647&v=beta&t=4Giiswtcz3j-bvFUJcJl_A5ehJeTwSrGOs8wxQhFdHo",
"logo": "https://media.licdn.com/dms/image/v2/D560BAQGiz5ecgpCtkA/company-logo_200_200/company-logo_200_200/0/1688684715866/ibm_logo?e=2147483647&v=beta&t=yWxQj1oew7nR92bDw8r80j2EiCwx29aNxLZktJYrsWw",
"similar": [
{
"Links": "https://www.linkedin.com/company/google?trk=similar-pages",
"subtitle": "Software Development",
"title": "Google",
"location": "Mountain View, CA"
},
// ... more similar companies
],
"url": "https://www.linkedin.com/company/ibm",
"updates": [
{
"likes_count": 379,
"text": "#GenAI presents a unique opportunity to close the leadership gap between men and women and can help address the current disparity in the leadership pipeline...",
"time": "1d",
"title": "IBM",
"comments_count": 20,
"external_link": "https://www.linkedin.com/pulse/ibm-launches-initiative-help-bridge-gender-gap-womenai-ibm-dxmke?trk=organization_guest_main-feed-card_feed-article-content",
"images": [
"https://media.licdn.com/dms/image/v2/D5612AQH2nBI_OF__TA/article-cover_image-shrink_720_1280/article-cover_image-shrink_720_1280/0/1726001225431?e=2147483647&v=beta&t=VuqkYEDDxHELcLo8pX95bRfGwQfUHii16ook1lpl1hk"
],
"post_url": "https://www.linkedin.com/posts/ibm_ibm-launches-an-initiative-to-help-bridge-activity-7239391324389462017-nEXi",
"post_id": "7239391324389462017"
},
// ... more updates
],
"affiliated": [
{
"title": "IBM Consulting",
"subtitle": "IT Services and IT Consulting",
"Links": "https://www.linkedin.com/showcase/ibmconsulting/?trk=affiliated-pages"
},
// ... more affiliated companies
],
"stock_info": {
"id": "IBM",
"datetime": "September 12, 2024",
"stock_exchange": "NYSE",
"stock_ticker": "IBM",
"stock_price": "$211.98",
"stock_price_change": "2.09 (0.996%)",
"stock_provider": "Data from Refinitiv"
},
"description": "IBM | 17,226,208 followers on LinkedIn. At IBM, we do more than work. We create. We create as technologists, developers, and engineers."
}
]
import requests
import json
# Your API Key
api_key = 'YOUR_API_KEY'
# API Endpoint for company information
url = 'https://taskagi.net/api/social-media/linkedin-scraper/companies'
# Headers
headers = {
'Authorization': f'Bearer {api_key}',
'Content-Type': 'application/json'
}
# Request Body
data = {
'url': 'https://www.linkedin.com/company/ibm'
}
# Send POST request
response = requests.post(url, headers=headers, json=data)
# Check if the request was successful
if response.status_code == 200:
# Parse the JSON response
company_info = response.json()
# Print the company information
print(json.dumps(company_info, indent=2))
else:
print(f"Error: {response.status_code}")
print(response.text)
# Example for job listings by keyword
url = 'https://taskagi.net/api/social-media/linkedin-scraper/jobs-by-keyword'
# Request Body for keyword search
data = {
'keyword': 'software engineer'
}
# Send POST request
response = requests.post(url, headers=headers, json=data)
# Check if the request was successful
if response.status_code == 200:
# Parse the JSON response
job_listings = response.json()
# Print the job listings
print(json.dumps(job_listings, indent=2))
else:
print(f"Error: {response.status_code}")
print(response.text)