Search Results
| Search type | Search syntax |
|---|---|
| Tags | [tag] |
| Exact | "words here" |
| Author |
user:1234 user:me (yours) |
| Score |
score:3 (3+) score:0 (none) |
| Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
| Views | views:250 |
| Code | code:"if (foo != bar)" |
| Sections |
title:apples body:"apples oranges" |
| URL | url:"*.example.com" |
| Saves | in:saves |
| Status |
closed:yes duplicate:no migrated:no wiki:no |
| Types |
is:question is:answer |
| Exclude |
-[tag] -apples |
| For more details on advanced search visit our help page | |
Results for scraping
Search options not deleted
15
votes
9
answers
22k
views
Download all words from Wiktionary for offline use
I need to learn as much words as I can, so it'd take years to learn these as a non native English speaker. I want to import words from Wiktionary, so that I can mark or delete words I already learn. I …
- 251
9
votes
3
answers
8k
views
Database for storing large sets of data from web scraping
I am designing a scraping system that will scrape large set of data from websites. The system is expected to collect data from websites and store it to database. … For example: If it's scraping a hotel listing, the data would contain the hotel id, hotel name, location, price, reviews, ratings, URL, etc. …
- 211
7
votes
3
answers
414
views
Web service that serves as public proof that a given url contains something at a given time
I did something "amazing" on a website and my narcissistic side wants proof for posterity that I managed to actually do it, even if the website in question decides to change it's rules or goes off-lin …
7
votes
Download all words from Wiktionary for offline use
The FAQ points to the Download page.
http://download.wikimedia.org/enwiktionary/ should have the latest copy of the main namespace.
The cleanest navigation page is http://download.wikimedia.org/. Ju …
user416
6
votes
Accepted
Web service that serves as public proof that a given url contains something at a given time
I think icanprove.com might fit your needs.
The screenshots are not presented online. They are stored in signed pdfs so you have to upload them themselves but on the other hand this gives you more co …
6
votes
3
answers
2k
views
Python library for complex web scraping?
My goal is to interact with a website (Portfolio123.com) and download financial study results.
To get to the content means logging in, then clicking buttons and/or filling forms. Some of these button …
- 161
6
votes
2
answers
146
views
Tool for Creating List of Businesses Located in Specific Suburb
I am thinking of a web scraper that will scrape a google search (of businesses in a suburb) but maybe there is another option I am not aware of? … Having a website like Yelp could be another way of scraping because the business name is always located in the same location of the page. …
- 243
5
votes
1
answer
241
views
High-accuracy digit OCR from a mobile screen shot
Objective
To scrape a table of dollar amounts from a screen image taken on a mobile device. We’ve examined all the frequently-recommended solutions, but they don’t satisfy our constraints. … Source scraping
There is no textual native format such as HTML or text PDF. I'm stuck with the pixmap. …
- 161
4
votes
Accepted
What are the best available options for HTML scraping?
jsoup – Java Library for Fetching & Parsing
For fetching and parsing HTML, I use the Java-based library, jsoup. It manages amazingly well with mangled mal-formed HTML code.
Has a variety of ways to …
- 3,148
4
votes
1
answer
1k
views
Push Android APK update to Google Play Store by command line
As it will probably rely on web UI scraping, it doesn't expect 100% reliability.
Works for beta APKs too. …
- 19.7k
4
votes
Web service that serves as public proof that a given url contains something at a given time
After grepping the archive.org FAQ just found that it does have a "Save page now" box under https://archive.org/web/ ...
I found this after noting that if a page had not been crawled when you search …
4
votes
2
answers
83
views
Store and run queries on political, economic, demographical, ++ country data
I will scrape country data from many different sources and combine it all into one dataset. …
- 49
4
votes
Accepted
Python & PDF parsing: any modern, powerful, well-maintained open-source libraries out there?
Finally I went for OCRmyPDF (https://github.com/jbarlow83/OCRmyPDF), which uses tesseract for the actual OCR part (https://github.com/tesseract-ocr/tesseract) - as I understand tesseract is a OCR tool …
- 181
4
votes
4
answers
8k
views
Software to download all images from an entire website
I'm looking for software that will recursively crawl a website to download all of the images from the entire website. (Not just from a single webpage.)
To illustrate:
If the site is www.example.com …
user22923
4
votes
1
answer
179
views
Notepad for programmers, scripters, hackers, developers, etc
I'm looking for a nice application that … well, I'm not quite sure exactly what it might be called, or if what I'm thinking of currently even exists as such. I will try to describe it. I guess it migh …
- 391