Sounds like Sqlite would be just the thing. Sqlite comes as a C library and command-line utility that executes SQL statements against a database file. The software intelligently cootdinates multiple connections to one file, but doesn't use a client-server architecture.
You can use RBQL from the command line (RBQL in pip) And from Rainbow CSV text editor extensions which provide nice GUI and are available for VSCode, Atom, Sublime Text, and Vim. And you can also try RBQL online without installing anything - rbql.org