I'm looking for a web application (either the third-party hosted or hosted by myself) that can:
- load and display a text
- allow the user to mark a word or a group of words as belonging to a predefined class
- record for each such mark which user did it
- RDBMS back-end for storing the data
Here is my use case to clarify the need: I have 1000 news articles (plain text, written in English), I need to mark among those articles all words or a group of words that express a positive or negative sentiment (i.e. I have 2 classes). I'm going to use Amazon Turk/oDesk/etc. to crowdsource the task, hence the choice for a web interface. I will ask each worker to annotate a subset of those 1000 news articles. Each news articles will be annotated by 3 workers to ensure the annotations' quality.