In a recent project, I found it necessary to collect bulk data from
different online sources in order to centralize it and make it easier
for me to find and to make sense of. Unfortunetly some of those sources
didn't have public APIs. So I decided to code this module and try my hand
at a little web crawling and scraping to obtain the metadata. Many people
when faced with the same issue have turned towards Python.
- The full project source file can be found in the scraper.py file.
IN NO EVENT SHALL I BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.