I am wanting to detect corrupt and inaccurate records to check for data quality from large data sets that originate from Microsoft Access and Excel.

Things I would like to check for:

Validity which includes: data-type constraints, unique constraints, foreign-key constraints, regular expression patterns, cross-field validation

But also other things like data accuracy, completeness, consistency, uniformity

What is the best platform to use? RStudio or SQL? I am using Windows.

Many thanks!

  • Please describe corrupt and inaccurate records better. Invalid field data, invalid references, etc? How large are 'large datasets' (byte size, record counts)? How much automation do you want, how would you like the interface to be? Also, what price, what OS? And why is your question tagged mysql, sql and sqlite if the data is in Access and Excel? Please read this and edit your question. – Jan Doggen Jun 12 at 9:28
  • Hi, I have updated; hope that helps? – elo2009 Jun 12 at 9:38
  • It really helps if you answer all the questions. And I wonder why you already suggest two generic 'platforms' - are data validation applications not welcome? – Jan Doggen Jun 12 at 9:41
  • I don't have more information to go on as I have yet to access most of the data. I am asking this question in order to know which platform I can practice on. – elo2009 Jun 12 at 9:43
  • I am not a tech expert and I do not appreciate being talked down to. I am only looking for support. – elo2009 Jun 12 at 9:45

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.