Developed a Python Web crawl,web scraper and error checker tool with Genevieve Okon and Eric Le Fort
Purpose:
- Assists with data analysis such as searching for data on a specific organization on the web.
- Provides a useful tool for web developers to monitor the status of their website.
- Nice tool for the web enthusiast that wants to download a webpage’s content quickly.
Features:
- Crawls Websites
- Searches for Certain Data
- Downloads Resources from Page
- Returns Status Codes of Webpages
- Utilizes Breadth-First Crawling and Knuth Morris Pratt String Search Algorithms
The code was fully documented and tested, all test files and documents are on GitHub
