I am looking for a recommendation for a tools to do some NLP/ML tasks.
My specific problem is as follows:
I have a large amount of Twitter data that we have taken from raw Tweets and have converted them into data output via a specific set of rules and analysis for our problem set. Across several hundred thousand rows I have the raw tweet and it has a corresponding output. A similar example might be a raw tweet describing weather conditions and then outputting a specific weather report like Anytown USA, Temp 72F.
Our specific conversion has some specific characteristics, but my thesis is that the underlying logic we created to analyze the tweets can be broadly applied to some other adjacent areas.
Here is a specific example:
Sample tweet - baseball: putnam city north 5 - choctaw 8 final @jacketsball @pcn_panthers #okpreps https://t.co/cna2up7qb8
We then parse that tweet to validate a user who submits a score. The information we extract from that tweet would be as follows:
putnam city north 5 choctaw 8 final
We have a lot of underlying logic that extracts that information based on a variety of parameters and we then used the extracted information to validate user reported information.
Hopefully that is more clear?
I am headed down the path of trying to run this data through some tools but I have to think that there might be some specific tools that fit the above profile I am looking for. Any thoughts or recommendations would be appreciated.