I am looking for an open source program to recognise known features, letters, numbers and symbols, displayed on my screen on a 2D plane.

There may be some occlusion or particle effects over the images.

In this particular case I am trying to detect features from Hearthstone (an online card game).

The best answer will answer the question for a general case matching the features I am trying to identify as I want to develop with this and use it for other similar games.

1 Answer 1


On Linux/Mac, I use Sikuli. It automates anything you see on the screen. It uses image recognition to identify and control GUI components. It is useful when there is no easy access to a GUI's internal or source code.


Sikuli is a JAVA app and cross-platform (Win, Mac, Linux).


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.