Web scraping tools and software available for free

Question

What are some free ready-to-use web scraping applications?

Usage: Monitoring online product prices, vendors, top 20 online market places in Asia and comparing price developments.

I am a beginner using Python and have a Raspberry Pi setup.

I am looking for the following capabilities and functions:

Welcome to Software Recommendations! What's "best" is always subjective: one man's trash is another man's treasure. Better describe what would make this software fitting best for you – which then enables us to give fitting recommendations. See What is required for a question to contain "enough information"? for more hints. — Izzy, Commented Jan 21, 2019 at 0:15

Peter Mortensen · Accepted Answer · 2023-01-08 04:32:20Z

1

For Python, my favorite is hands down Scrapy.

If you want a GUI for it, Portia.

^^ If you want a GUI to install and run that Docker container: https://kitematic.com/

Peter Mortensen

1708 bronze badges

answered Jan 24, 2019 at 1:17

Brady coye

211 bronze badge

1

If that is more than you're comfortable with: webscraper.io
– Brady coye
Commented Jan 24, 2019 at 1:18
Scrapy is the answer, although it might be worth looking at Beautiful Soup
– Mawg
Commented Feb 25, 2019 at 13:12
https://kitematic.com/ redirects to the generic https://www.docker.com/. What is/was it?
– Peter Mortensen
Commented Jan 2, 2023 at 13:27

Add a comment |

1 Answer 1