Web scraping and web crawling with Python
Do you know how to scrape data from the web? Have you ever heard of spiders? Spiders are small bots capable of automating such tasks. If this interests you, join me in a talk about my experience with these techniques on the market and some initiatives I drove using them to teach programming.
- Timeslot: Sunday, 6th April 2025, 15:00-16:00, Room A
- Tags: Web
In this talk, I plan to cover the high-level concepts of scraping and crawling.
I’ll discuss the BeautifulSoup library, a very beginner-friendly option. In my home country,
I led initiatives to teach basic programming concepts using this library, and I enjoyed seeing the interesting
mini-projects that resulted from those efforts.
I’ll also share my experience with market-oriented scraping using the Scrapy framework
— a more scalable and automated solution for larger projects.
My name is Lidiane, but feel free to call me Lidi. I’m a Brazilian software engineer who has been working in web development since 2015 — partly in Brazil, partly in Berlin, and now in London, where I work at Artsy. While I primarily see myself as a back-end engineer, I’ve been striving to balance that with front-end work over the past couple of years. Outside of tech, I spend most of my time playing with my two lovely dogs, baking sourdough bread, or exploring vegan restaurants with my partner.
