1

I am looking for a recommendation for a tools to do some NLP/ML tasks.

My specific problem is as follows:

I have a large amount of Twitter data that we have taken from raw Tweets and have converted them into data output via a specific set of rules and analysis for our problem set. Across several hundred thousand rows I have the raw tweet and it has a corresponding output. A similar example might be a raw tweet describing weather conditions and then outputting a specific weather report like Anytown USA, Temp 72F.

Our specific conversion has some specific characteristics, but my thesis is that the underlying logic we created to analyze the tweets can be broadly applied to some other adjacent areas.

Here is a specific example:

Sample tweet - baseball: putnam city north 5 - choctaw 8 final @jacketsball @pcn_panthers #okpreps https://t.co/cna2up7qb8

We then parse that tweet to validate a user who submits a score. The information we extract from that tweet would be as follows:

putnam city north 5 choctaw 8 final

We have a lot of underlying logic that extracts that information based on a variety of parameters and we then used the extracted information to validate user reported information.

Hopefully that is more clear?

I am headed down the path of trying to run this data through some tools but I have to think that there might be some specific tools that fit the above profile I am looking for. Any thoughts or recommendations would be appreciated.

closed as too broad by Nicolas Raoul May 29 at 8:11

Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • So you want a tool that takes some text (a raw tweet), and extracts what? Any adjacent information? That sounds like a very broad request to me. There are thousands of tools that can give you adjacent information from some text. – Nicolas Raoul May 29 at 8:11
  • Here is a specific example: Sample tweet - baseball: putnam city north 5 - choctaw 8 final jacketsball pcn_panthers #okpreps t.co/cna2up7qb8 We then parse that tweet to validate a user who submits a score. The information we extract from that tweet would be as follows: putnam city north 5 choctaw 8 final @NicolasRaoul – Derrick Oien May 29 at 22:28