I have a list of 1,000 URLs pointing to news articles. I am looking for a program (CLI if possible) or libraries (C++/Java or interpreted languages preferred) that can take a URL as input and output the main content of a page written in English. It is OK if it is specialized for news articles only.
E.g. if the input URL is http://news.sky.com/story/384359/russia-fake-vodka-kills-25-people, it should return:
A deadly form of fake vodka has killed 25 people in Russia, prompting police to issue a public warning. The batch of illegal alcohol has been tracked down to the far east of the country in Siberia.
Local news agencies reported that 25 people had bought drinks contaminated with methanol, a form of alcohol that can cause blindness or kill.
After it appeared their deaths may be connected, police issued a warning to local residents to avoid buying the vodka substitute.
Four women have since been arrested for running an illegal distillery that may have produced the deadly drinks.
Although vodka is very cheap in Russia, many prefer to buy home-made varieties - known as "samogan" - to save money.
Fake vodka is often made from wood alcohol which is meant for industrial purposes.
Alcohol poisoning kills thousands of Russians every year; 39,000 died in 2004 alone.
Russia: Fake Vodka Kills 25 People
If possible, free and working with Windows 7 or Linux.