Hot answers tagged

10 votes

Is there a software tool which allows to perform SQL on CSV files?

Have a look at q q is a command line tool that allows direct execution of SQL-like queries on CSVs/TSVs (and any other tabular text files). https://github.com/harelba/q
9 votes

Is there a software tool which allows to perform SQL on CSV files?

The 'problem' with a CSV file is that the single 'table' doesn't have a name. Therefore, you'll need to define a table (including columns) and import the CSV file before doing any SQL queries on it. ...
  • 2,009
8 votes

Fastest free Python library to read a CSV file with 1~3 columns of numbers

I would like to contribute another library here, that I stumbled over looking for similar question. I tested it with Franck Dernoncourts benchmark code and it beats Pythons standard csv and Pandas by ...
5 votes

Program to generate a CSV file from an image containing a table

I have found something amazing http://tabula.technology/ this is the best tool we have! It's also Free. It works really well with PDF files but even works fairly well with well formed tables like ...
  • 101
5 votes
Accepted

Viewer for huge CSV files which don't fit in memory

You could try reCsvEditor, a CSV file viewer/editor which supports a wide variety of field delimiters, very large files and Unicode Files. Files are displayed in a table format. It seems to match all ...
  • 1,780
5 votes
Accepted

Convert JSON to CSV

Python is: Free, Gratis & Open Source including commercial use Available for windows, along with just about everything else, although recent versions (post 2.5.4) have dropped Windows XP support ...
  • 31.1k
5 votes

Modern C++ CSV reader/parser library

Two libraries that fits the requirements and several of desired features: Rapidcsv CSVstream Fast C++ CSV Parser I start to test them few days ago, so I can not confirm all the features, however I ...
  • 151
4 votes

Get random records from CSV files

This is really a job for a scripting language. The task you describe is so specific that you're very unlikely to find a tool that does exactly that. On the other hand, it can be written in a few ...
4 votes

Lightweight contact manager for Linux with import & export feature

Osmo has been around for years and is pretty good - the GUI's not so flashy, but it's pretty lightweight with minimal dependencies. It has basic import/export functionality, as well as everything you'...
  • 1,616
4 votes

Software to build a regression model with 3.5 GB CSV on a low memory PC

Take a look at the Dask library. (http://dask.pydata.org/en/latest/). It extends pandas' DataFrames and Numpy arrays for larger-than-memory computation. Here's a blog post about using Dask with ...
4 votes

Is there a software tool which allows to perform SQL on CSV files?

If you have the flexibility to use some light scripting languages try - R script - It has sqldf library which can be used to run sql queries on dataframes. You just have to read your csv into a ...
  • 141
4 votes

Is there a software tool which allows to perform SQL on CSV files?

Using PostgreSQL and DBeaver is another option. PostgreSQL is a sophisticated, open source database system. It allows for importing CSV files through the COPY command and through graphical UIs such as ...
4 votes
Accepted

Open-source CSV viewer & editor

I like OpenRefine. According to the documentation : OpenRefine is a Java-based power tool that allows you to load data, understand it, clean it up, reconcile it, and augment it with data coming from ...
  • 311
3 votes

Program to generate a CSV file from an image containing a table

ABBYY FineReader does very good job when it comes to optical recognition. Probably the best on the market. And it can also export to *.csv, among many other formats. The downside is, it is not free ...
  • 282
3 votes

Offline CSV validator

Take a look at csvkit, a python library for working with CSV data with accompanying command line scripts. It's designed to be smart about character encoding (and can be used to convert or normalize ...
3 votes

Offline CSV validator

It's somewhat unclear how far your requirements stretch, but in general most scripting languages have a CSV parser of their own, and can be used from the command line. If there's an error in your CSV ...
3 votes

Speadsheet software that can handle thousands of columns

You could always look at Pyspread which reports that while row & col sizes depend on memory size, etc. according to the FAQ: For standard size on GTK platforms, 80 000 000 rows can be displayed. - ...
  • 31.1k
3 votes

Bulk search and replace in text file with results from CSV or spreadsheet?

I'm not entirely sure if I understand your intention correctly, but at least on Linux that should be easily done using core command line utilities like sed or awk. sed is a stream editor, which ...
  • 18.5k
3 votes

Tool for converting Excel files to CSV

I would suggest using python with the xlrd library, the conversion could be as simple as: from xlrd import open_workbook import os import sys def xl2csv(filename): """ Convert an excel file to ...
  • 31.1k
3 votes

Convert JSON to CSV

Since you are in a Windows environment have you considered PowerShell? It meets all of your criteria and you already have it available (no need to install anything). This command will do what you ...
3 votes

Web app for reviews of proposals imported from CSV

You can try out the Proposal Review template on Simitless. you can either use it as is or take it as inspiration and modify it by deleting or adding new columns (or creating new things altogether), ...
  • 1,964
3 votes

Is there a software tool which allows to perform SQL on CSV files?

SQLite is a nice lightweight tool that is supported by multiple languages. If you use Python, there are several tools in the Python Package Index (pypi.org) that make it easy to use (including https:/...
3 votes

Is there a software tool which allows to perform SQL on CSV files?

Try csvsql. It is part of csvsuite, a suite of command line tools written in python, since March 2019 tested against Python 3.7. The csvkit tools are described in the book Data Science at the ...
  • 2,216
3 votes
Accepted

"MailMerge" for CSV + Markdown

I was looking for something similar, and since I could not find it, I wrote a small python script following the principles outlined by rd_nielsen. https://gist.github.com/frederik-elwert/...
3 votes

Parsing large (30GB) XML into CSV (with Python)

One possibility is a streaming XSLT 3.0 processor, which given your constraints means in practice Saxon/C Enterprise Edition (this has a Python language binding). There is actually a CSV-to-XML ...
3 votes
Accepted

WYSIWYG CSV editor that logs changes

Try using version-control software, such as Git. You can then edit the file however you want, such as with your favorite text editor, and you'll be able to look at previous versions and the ...
  • 1,139
2 votes

Tool to generate CSV lists from Wikidata

You can query Wikidata with SPARQL at https://query.wikidata.org/. I created the command line tool wdq to facilitate querying from command line. You task can be solved as following (please use the ...
  • 161
2 votes
Accepted

Bulk search and replace in text file with results from CSV or spreadsheet?

If I've understood you correctly, then this should be pretty easy in Bash (sorry, GNU/Linux only). Create a script like this in your favourite text editor: #!/bin/bash FILENAME="" cat a.csv | while ...
  • 1,616
2 votes

PDF to Spreadsheet Converter for bank statements

I had the same problem - Belgium's ING Bank now provides statements only as format pdf, with layout ± exactly as described in the post. I tried 4 or 5 Open Source text extractors. The best was ...
2 votes

Offline CSV validator

You could use the bash itself to write a good validator for CSV file. You can refer to this previous post. It explains how to use "awk" command to realize a validator for fields and for the file ...
  • 129

Only top scored, non community-wiki answers of a minimum length are eligible