Skip to content

My process in scraping jobs from from the ihub jobs website. All jobs were saved in a json file, then exported to mongodb for use in an api project.

Notifications You must be signed in to change notification settings

ItsCosmas/scrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 

Repository files navigation

scrapy

Web Scrapper

  • The notebook contains the code for my process in extracting jobs from the ihub jobs website
  • I saved the jobs as a json file that I'll export to mongodb
  • Exporting to mongodb via this terminal command mongoimport --db scrapy --collection jobs --file ihub.json --jsonArray
  • Check out the scrapy-edge repository where I build a flask endpoint to expose the jobs.

About

My process in scraping jobs from from the ihub jobs website. All jobs were saved in a json file, then exported to mongodb for use in an api project.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published