1

My company has a requirement to monitor a number of webpages for changes to content, with the ability to filter out parts of the pages we're not interested in.

Does anyone have experience of the best way to achieve this?

We have tried a number of solutions, but they all are either very buggy or just seem to miss changes completely.

Improve this question
1
  • 1) Could be helpful to list the software you’ve already tried. If you can, please edit your question. 2) Should it be a Web app or a local client? If local client, for which operating system(s)? 3) Does the solution have to support running JavaScript? 4) Do you have a budget? – unor Apr 14 '17 at 23:53
1

I use Smart WebMonitor for monitoring changes to webpages, the email alerts are very useful. It stores a screenshot of the page for each change, which is useful.

It is already good at ignoring changes to sidebars etc. but you can filter out other parts of the page fairly easily as well.

Improve this answer
1
  • Thanks for the suggestion, we'll trial this and some other solutions. – Francis H Apr 13 '17 at 8:31
0

What solution have you tried ? If a minimum of human intervention is acceptable, the firefox plug-in Update Scanner might just be what you're looking for.

Features:

  • Select how often each site will be scanned
  • Changes to pages are highlighted automatically
  • Minor changes can be ignored
  • Full international support

cf. their webpage and the support.

Improve this answer
4
  • Thanks, I think we'll need a server based service, rather than a plugin. – Francis H Apr 13 '17 at 9:29
  • Ok, very well, Francis, thanks for your comment. Two remarks: 1) you might consider editing your question to reflect that aspect, and make it more precise, and 2) upvoting answers is the best way to say "thank you". – Clément Apr 13 '17 at 15:44
  • It doesn't work on Twitter. – Shayan Oct 1 '19 at 20:39
  • 1
    @Shayan I'm sorry it is not working for you. It's hard to understand why it would not be working from your message. What do you mean? It reports the page as having changed whereas it did not? Or it just does not report the page as having changed? You may want to look at the tickets open on Update's scanner repository with the keyword twitter, and see if one of them address your concern : github.com/sneakypete81/updatescanner/… – Clément Oct 2 '19 at 16:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.