Skip to content

This project demonstrates an example of Web scraping by retrieving data from the info.lt webpage and presenting it to the user.

Notifications You must be signed in to change notification settings

visva-dev/Ruby-web-scraper-project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Ruby web scraper project

Web scraper project for Microverse Ruby Capstone

Description

This project demonstrates an example of Web scraping by retrieving data from the info.lt webpage and presenting it to the user.

The Scraper presents retrieved data to the user depended on their selection or response :

  • Choice 1 : User need's to choose to run scraper or not

  • Choice 2 : Choose what info they want to get - All lawyers info or just a names, addresses, website links or working times.

    Choices
    Choice to show lawyers names

    How to run this Scraper

    This scraper can run on your computer or online.

Run it On your computer

Pre-requisites

  1. You should have Ruby installed on your computer.
  2. Your computer should be able to run terminal or command prompt or bash or Powershell commands.

Using a Repository

  1. Run this command git clone https://github.com/visva-dev/Microverse-Ruby-Capstone.git in the desired folder to clone the repository on to your local machine. After cloning the project, you should cd into the directory where the code is stored & nevigate into bin older using cd bin

  2. Then run to following command install the necessary dependencies

    bundle install
  1. And last command to run the scraper
    ruby bin/main.rb
  1. And you should see a welcome message indicating the scraper has opened and ready for work, follow the instructions and you will get data which you need.

B. Online

  1. click the following link Scraper's link
  2. When the link has been opened, click the green run button you will see at the top to run the Scraper.

Demo Video

Click the following link to see Video presentation of the project.

How to run Rspec tests:

When you are in Microverse-Ruby-Capstone folder, open your terminal & run rspec program will run tests for this project.

Built With

  • Ruby
  • Nokogiri Gem

Tested With

  • Rspec

Authors

👤 Visvaldas Rapalis

Show your support

Give a ⭐️ if you like this project!

Acknowledgments

  • This project was inspired by the Microverse program

📝 License

This project is MIT licensed.

About

This project demonstrates an example of Web scraping by retrieving data from the info.lt webpage and presenting it to the user.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages