Web scraping and web crawling with Python
In this talk, I plan to cover the high-level concepts of scraping and crawling.
I’ll discuss the BeautifulSoup library, a very beginner-friendly option. In my home country,
I led initiatives to teach basic programming concepts using this library, and I enjoyed seeing the interesting
mini-projects that resulted from those efforts.
I’ll also share my experience with market-oriented scraping using the Scrapy framework
— a more scalable and automated solution for larger projects.
My name is Lidiane, but feel free to call me Lidi. I’m a Brazilian software engineer who has been working in web development since 2015 — partly in Brazil, partly in Berlin, and now in London, where I work at Artsy. While I primarily see myself as a back-end engineer, I’ve been striving to balance that with front-end work over the past couple of years. Outside of tech, I spend most of my time playing with my two lovely dogs, baking sourdough bread, or exploring vegan restaurants with my partner.
