i get raw data quarterly. Essentially they are dumps from relational database tables. I import them into mysql bounce them against a reference database to get some validated columns then export the completed table with raw and validated columns.

right now i do it all manually via a workflow of the same sql queries over and over again. i would like to at minimum automate my mapping process but would also like the opportunity to build in analysis and possible breakpoints for custom transformation, etc. However, these are very large tables so the work should still be done by the database engine I would think.

  • Welcome to Software Recommendations! Can you please edit your question and add some more details – e.g. what OS the application must run on, what your price limit is in case of paid solutions, what specific features you need. See What is required for a question to contain "enough information"? for a raw guide. The better you describe your needs, the better answers can match them ;) – Izzy Jul 19 '19 at 6:24
  • Automating a process such as you describe would ordinarily be done with a SQL script processor such as the mysql command-line tool. If this will not work for your use case, what requirements do you have that aren't met? – rd_nielsen Jul 19 '19 at 13:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.