Ways to avoid the painful pitfalls of web scraping — Introduction Whether for work or for fun, web scraping is a critical skill that every data scientist should have in their arsenal. It opens the door to an immeasurable amount of data beyond the restrictions of what you can find on Kaggle or other open data websites. …