Can anyone suggest a program that can go through a list of URLs and scrape the URLs for a specific link?
I have roughly about 1000 links that I want to find if it has a specified page which ideally can be searched by keywords. I thought of writing my own program to do this but prefer not to reinvent the wheel.
The ideal script/program can be run on Windows or any Linux distribution and free.