Questions tagged [scraping]
Web scraping is the process of collecting selected data from one or more web pages for storage or further processing.
4
questions
3
votes
2
answers
121
views
What are good tools for automatically crawling websites, check for certain links, and extract data?
I would like to automatically crawl about 1 million URLs (on a CSV file) and check whether the sites provide a Facebook Login button (i.e., users can create accounts by connecting their Facebook ...
- 133
2
votes
1
answer
253
views
GUI scraper allowing the extract a specified element of a webpage for a list of URLs having a similar structure
I am looking for a program that can extract a specified element of a webpage for a list of pages having a similar structure.
To put it otherwise, I would first specify the location of the text that ...
- 37.3k
2
votes
2
answers
126
views
Text or summary extractor from webpage
I look for a software or add-on (Firefox) to extract the main text of a webpage.
For example for a Wikipedia article it must extract the article and omit the navigation bars, references or headers ...
- 467
0
votes
2
answers
427
views
What are the best available options for HTML scraping? [closed]
I'm currently using PHP DOM with CURL and Simple HTML DOM Parser for HTML scraping.
I need to scrape large set of contents and it need to stored. I am using PHP as my main language and MySQL as ...
- 211