Rebecca Sutton Koeser rlskoeser
rlskoeser
/ cdh-scrape.py
Last active
September 12, 2018 18:07
— forked from meg-codes/cdh-scrape.py
A basic web-scrape script designed to get summary information an all resources on a site; includes a report of bad links
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/usr/bin/env python | |
| # Script to scrape all links from a site, compile counts of each link, status | |
| # codes of access and output the results as a CSV | |
| # | |
| # There's absolutely no reason this shouldn't be pulled into an OOP paradigm | |
| # per se, but I left it functionalized because that can be easier for multitasking. | |
| # | |
| # Requirements: | |
| # requests, bs4 |