Skip to content
JobSpy logo

JobSpy

By speedyapply·4,806

Search LinkedIn, Indeed, ZipRecruiter, Glassdoor and regional job boards

JobSpy

PyPI version Python versions Downloads per month CI License: MIT Discord

JobSpy is a job scraping library that aggregates jobs from popular job boards with one tool:

  • Scrapes job postings from LinkedIn, Indeed, ZipRecruiter, Glassdoor, SEEK (with JobStreet & Jobsdb), Naukri, HelloWork, Bayt & BDJobs concurrently
  • Aggregates the job postings in a dataframe
  • Proxy support to bypass blocking

JobSpy demo

Installation

pip install -U python-jobspy

Python version >= 3.10 required

Usage

from jobspy import scrape_jobs

jobs = scrape_jobs(
    site_name=["linkedin", "indeed", "zip_recruiter", "glassdoor"],  # also "seek", "naukri", "hellowork", "bayt", "bdjobs"
    search_term="software engineer",
    location="San Francisco, CA",
    results_wanted=20,
    hours_old=72,
    country_indeed="USA",
    # fetch_description=True,  # read each job's page on boards whose search results have no description (slower)
    # proxies=["user:pass@host:port", "localhost"],
)
print(f"Found {len(jobs)} jobs")
print(jobs.head())
jobs.to_csv("jobs.csv", index=False)

Output

SITE           TITLE                             COMPANY           LOCATION                JOB_TYPE  INTERVAL  MIN_AMOUNT  MAX_AMOUNT  JOB_URL                                            DESCRIPTION
indeed         Software Engineer                 AMERICAN SYSTEMS  Arlington, VA, USA      None      yearly    150000      200000      https://www.indeed.com/viewjob?jk=5e409e577046...  THIS POSITION COMES WITH A 10K SIGNING BONUS!...
indeed         Senior Software Engineer          TherapyNotes.com  Philadelphia, PA, USA   fulltime  yearly    110000      135000      https://www.indeed.com/viewjob?jk=da39574a40cb...  About Us TherapyNotes is the national leader i...
linkedin       Software Engineer - Early Career  Lockheed Martin   Sunnyvale, CA, USA      fulltime  yearly    None        None        https://www.linkedin.com/jobs/view/3693012711      Description:By bringing together people that u...
linkedin       Full-Stack Software Engineer      Rain              New York, NY, USA       fulltime  yearly    None        None        https://www.linkedin.com/jobs/view/3696158877      Rain’s mission is to create the fastest and ea...
zip_recruiter  Software Engineer - New Grad      ZipRecruiter      Santa Monica, CA, USA   fulltime  yearly    130000      150000      https://www.ziprecruiter.com/jobs/ziprecruiter...  We offer a hybrid work environment. Most US-ba...
zip_recruiter  Software Developer                TEKsystems        Phoenix, AZ, USA        fulltime  hourly    65          75          https://www.ziprecruiter.com/jobs/teksystems-0...  Top Skills' Details• 6 years of Java developme...

Command line

The package installs a jobspy command whose options mirror the scrape_jobs() parameters below; jobspy -h lists them, the output fields and exit codes.

uv tool install python-jobspy

jobspy "software engineer" --site indeed,linkedin --location Chicago -n 20
jobspy nurse --site indeed,linkedin --hours-old 24 -o jobs.jsonl
jobspy "data analyst" --remote --fields title,company,job_url

MCP server

mcp-jobspy is an MCP server that runs with uvx mcp-jobspy@latest. See mcp/README.md for setup, tools and proxies.

Standard config works for most clients:

{
  "mcpServers": {
    "jobspy": {
      "command": "uvx",
      "args": ["mcp-jobspy@latest"]
    }
  }
}

Parameters for scrape_jobs()

Optional
├── site_name (list|str): 
|    linkedin, indeed, zip_recruiter, glassdoor, seek, naukri, hellowork, bayt, bdjobs, google
|    (default is all)
│
├── search_term (str)
|
├── google_search_term (str)
|     search term for google jobs. This is the only param for filtering google jobs.
│
├── location (str)
│
├── distance (int): 
|    in miles, default 50
│
├── job_type (str): 
|    fulltime, parttime, contract, temporary, internship, perdiem, other, volunteer
│
├── proxies (list|str): 
|    in format ['user:pass@host:port', 'localhost'], or a single proxy as a string
|    each job board scraper will round robin through the proxies
|    socks proxies on LinkedIn, Indeed and BDJobs need pip install "requests[socks]"
|
├── is_remote (bool)
│
├── results_wanted (int): 
|    number of job results to retrieve for each site specified in 'site_name'
│
├── easy_apply (bool): 
|    filters for jobs that are hosted on the job board site
|
├── user_agent (str): 
|    override the default user agent which may be outdated
│
├── description_format (str): 
|    markdown, html, plain (Format type of the job descriptions. Default is markdown.)
│
├── offset (int): 
|    skips that many results (e.g. 25 skips the first 25 and starts from the 26th)
│
├── hours_old (int): 
|    filters jobs by the number of hours since the job was posted 
|    (Glassdoor filters by whole days, so it rounds up to the next day.)
│
├── verbose (int) {0, 1, 2}: 
|    Controls the verbosity of the runtime printouts 
|    (0 prints only errors, 1 is errors+warnings, 2 is all logs. Default is 1.)
│
├── fetch_description (bool): 
|    for boards whose search results don't include the job description: fetches each job's
|    page for the description and other details (e.g. job type). Without it these are empty
|    for those boards. Adds one request per job, so use proxies for larger searches
│
├── linkedin_fetch_description (bool): 
|    deprecated, use fetch_description (still works; removed in 2.0)
│
├── linkedin_company_ids (list[int]): 
|    searches for linkedin jobs with specific company ids
|
├── country_indeed (str): 
|    picks the country site on Indeed, Glassdoor & SEEK (default is usa; see below for the names)
|
├── enforce_annual_salary (bool): 
|    converts wages to annual salary
|
├── ca_cert (str)
|    path to CA Certificate file for proxies

Supported Countries for Job Searching

LinkedIn

LinkedIn searches worldwide. location takes any place.

Indeed

Indeed searches one country. location takes a place in that country, e.g. city & state.
country_indeed (default usa) picks the country:

Argentina Australia Austria Bahrain
Belgium Brazil Canada Chile
China Colombia Costa Rica Czech Republic
Denmark Ecuador Egypt Finland
France Germany Greece Hong Kong
Hungary India Indonesia Ireland
Israel Italy Japan Kuwait
Luxembourg Malaysia Mexico Morocco
Netherlands New Zealand Nigeria Norway
Oman Pakistan Panama Peru
Philippines Poland Portugal Qatar
Romania Saudi Arabia Singapore South Africa
South Korea Spain Sweden Switzerland
Taiwan Thailand Turkey UK
Ukraine United Arab Emirates Uruguay USA
Venezuela Vietnam

ZipRecruiter

ZipRecruiter searches the US & Canada. location takes a place in either.

Glassdoor

Glassdoor searches worldwide. location takes any place, in any country, e.g. "Berlin" or "Vietnam".
country_indeed (default usa) picks the Glassdoor site; with no location it searches that site's country:

Argentina Australia Austria Belgium
Brazil Canada France Germany
Hong Kong India Ireland Italy
Mexico Netherlands New Zealand Singapore
Spain Switzerland UK USA

SEEK / JobStreet / Jobsdb

SEEK searches one country. location takes a suburb, city or region in that country, e.g. "Melbourne" or "Jakarta".
country_indeed picks the country; set it, as the default usa isn't one of them:

Australia Hong Kong Indonesia Malaysia
New Zealand Philippines Singapore Thailand

Naukri

Naukri searches India. location takes a city, e.g. "Pune".

HelloWork

HelloWork searches France. location takes a French city, postcode or region, e.g. "Lyon". Most jobs are posted in French, so French search terms find more.

Bayt

Bayt searches worldwide, with most of its jobs in the Middle East & India. location takes a country, or a city with its country, e.g. "Saudi Arabia" or "Dubai, UAE".

BDJobs

BDJobs searches Bangladesh. location takes a division or district, e.g. "Dhaka" or "Chattogram Division".

Notes

  • Indeed is the best scraper currently with no rate limiting.
  • Indeed's date_posted is the day a job was added to Indeed, the same date hours_old filters on.
  • Most job board endpoints are capped at around 1000 jobs on a given search.
  • LinkedIn rate limits bursts of requests with a 429, which clears within about a minute. Use proxies for larger searches.
  • Glassdoor rate limits above about 2 requests a second.

Frequently Asked Questions

Q: How do I tell a blocked board from one with no jobs?
A: Failures and ignored options are logged as they happen, and the result's attrs carry the same messages so your code can read them:

jobs.attrs["errors"]    # {"linkedin": "response status code 429 (blocked: use a proxy)"}
jobs.attrs["warnings"]  # {"bdjobs": ["job_type internship isn't supported, ignoring it"]}

Q: Why is Indeed giving unrelated roles?
A: Indeed searches the description too.

  • use - to remove words
  • "" for exact match

Example of a good Indeed query

search_term='"engineering intern" software summer (java OR python OR c++) 2025 -tax -marketing'

This searches the description/title and must include software, summer, 2025, one of the languages, engineering intern exactly, no tax, no marketing.


Q: No results when using "google"?
A: Google Jobs is currently unavailable.


Q: Received a response code 429?
A: The board blocked you for sending too many requests. All of the job board sites are aggressive with blocking. We recommend:

  • Wait some time between scrapes (site-dependent).
  • Try using the proxies param to change your IP address.

JobPost Schema

JobPost
├── id
├── site
├── job_url
├── job_url_direct
├── title
├── company
├── location
├── date_posted
├── job_type: fulltime, parttime, internship, contract, temporary, ...
├── salary_source: direct_data, description (parsed from posting), estimated (Glassdoor's own estimate)
├── interval: yearly, monthly, weekly, daily, hourly
├── min_amount
├── max_amount
├── currency
├── is_remote
├── job_level
├── job_function
├── listing_type
├── emails
├── description
├── company_industry
├── company_url
├── company_logo
├── company_url_direct
├── company_addresses
├── company_num_employees
├── company_revenue
├── company_description
├── skills
├── experience_range
├── company_rating
├── company_reviews_count
├── vacancy_count
└── work_from_home_type

A column is empty when the job board doesn't provide it.