Your tutorial tells people to “crawl responsibly”
|
# Crawl responsibly by identifying yourself (and your website) on the user-agent |
|
#USER_AGENT = 'chocolatescraper (+http://www.yourdomain.com)' |
Yet in your blog post, you advertise to deceive sites into thinking your scraper was a browser: https://scrapeops.io/python-web-scraping-playbook/python-httpx-fake-user-agents/
Please remove this blog entry.
Your tutorial tells people to “crawl responsibly”
python-scrapy-playbook/1_Beginner_Series/part_4__user_agents_and_proxies/chocolatescraper/settings.py
Lines 16 to 17 in 3f3ee05
Yet in your blog post, you advertise to deceive sites into thinking your scraper was a browser: https://scrapeops.io/python-web-scraping-playbook/python-httpx-fake-user-agents/
Please remove this blog entry.