0

Can anyone suggest a program that can go through a list of URLs and scrape the URLs for a specific link?

I have roughly about 1000 links that I want to find if it has a specified page which ideally can be searched by keywords. I thought of writing my own program to do this but prefer not to reinvent the wheel.

The ideal script/program can be run on Windows or any Linux distribution and free.

Improve this question
  • We'll need much more information to provide a solid recommendation. Please see 'What is required for a question to contain “enough information”?' and edit your question to contain enough information. For starters, what operating system does it need to run on? What budget do you have? – Undo May 29 '16 at 21:06
  • Thanks, I have edited my question. I hope it qualifies. – NuWin May 29 '16 at 21:20

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.