Skip to content

Latest commit

 

History

History
43 lines (34 loc) · 1.49 KB

File metadata and controls

43 lines (34 loc) · 1.49 KB

Python Webscraper

The purpose of this webscraper is to monitor a website for changes, then text a phone using Twilio if any changes exist. The program supports multiple websites and Twilio accounts running at the same time.

How to use

  1. LYNN WAS HERE Create a users.yaml file that contains the website you want to scrape and the Twilio account details. This can be done by running user_init.py from the command line and chosing e. Alternatively, you can create the file yourself. The file must contain the following:

    User0:
    {
    element: "Elemnt to watch (ex. h1)",
    name: "Name of user",
    repeat_num: "How many times to repeat total",
    repeat_rate: "how many times in between checks in seconds",
    twilio_auth: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    twilio_phone: "+xxxxxxxxxxx",
    twilio_sid: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    url: "url to watch",
    user_phone: "+1xxxxxxxxxx",
    }
    Use1:
    {
    element: "Elemnt to watch (ex. h1)",
    name: "Name of user",
    repeat_num: "How many times to repeat total",
    repeat_rate: "how many times in between checks in seconds",
    twilio_auth: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    twilio_phone: "+xxxxxxxxxxx",
    twilio_sid: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx",
    url: "url to watch",
    user_phone: "+1xxxxxxxxxx",
    }
    

    The file can have as many "users" as needed.

  2. Run webscraper.py. It will read from the users.yaml file and text the phone number stored in user_phone when the element changes.