Simple Python 3.x Web Crawler, Images, Urls, Emails, Phone numbers
-
Updated
Jun 7, 2024 - Python
Simple Python 3.x Web Crawler, Images, Urls, Emails, Phone numbers
Webcrawl is a Python web crawler that recursively follows links from a starting URL to extract and print unique HTTP links. Using 'requests and 'BeautifulSoup', it avoids revisits, handles errors, and supports configurable crawling depth. Ideal for gathering and analyzing web links.
Add a description, image, and links to the web-crawl topic page so that developers can more easily learn about it.
To associate your repository with the web-crawl topic, visit your repo's landing page and select "manage topics."