Hot answers tagged

4 votes

Stop logging to files. But what system to choose?

You might want to log to SQLite databases instead of plain text files for the following reasons: SQLite is part of the python standard runtime library. Thus, databases can be created, filled and ...
jf1's user avatar
  • 421
4 votes
Accepted

Stop logging to files. But what system to choose?

You might be able to use: https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elk-stack-on-ubuntu-14-04 Logstash forwards the logs to the central logging ...
cybernard's user avatar
  • 1,726
3 votes

Tool to compare the results of an SQL query on two databases

There is a tool called SelectCompare that allows you to compare two queries. SelectCompare allows to create comparison projects, which define queries against any two data sources that can be ...
db toro's user avatar
  • 41
3 votes

Undelete tools for Windows with high recovery rates

I have used Recuva to recover deleted files on Windows boxes. It generally works well. It's easy to use, and has a minimal learning curve. My big complaint with it is that for years they offered a ...
End Anti-Semitic Hate's user avatar
2 votes
Accepted

Scanning multiple choices answers from paper

If you are interesting in creating an application that can do this, I reccomend checking out the LEADTOOLS Forms Recognition SDK. This SDK has C DLL and .NET libraries for OMR recognition. The .NET ...
Russ L's user avatar
  • 186
2 votes

Backup/restore data multiple sets of data for selected Android apps

Helium - App Sync and Backup (originally named Carbon) has a gratis version and can do that: Helium (source: Google Play; click images for larger variants) It's quite a while since I last used it ...
Izzy's user avatar
  • 18.9k
2 votes

App to quickly and easily transfer small amount of data from Windows to Android

I would suggest an arbitrary combination of a Windows QR code generator (that can encode arbitrary portions of text) and an Android QR code reader app. I use this combination for exactly the same ...
O. R. Mapper's user avatar
2 votes

Linux/Windows app for graphing very large amounts of data

On linux, you might find gnuplot to be useful.
Akshay Joshi's user avatar
2 votes
Accepted

What programming language should I use to generate word lists of Google Ngram raw data

Python is quick and easy to learn plus there are domain specific tools for what you are trying to do as a part of the sci-kit learn package including being able to extract a corpus from an on-line ...
Steve Barnes's user avatar
  • 31.5k
2 votes
Accepted

Which compression utility should I use for an extremely large plain text file?

I've decided to go with Zstandard. I don't have exact numbers on hand, but this suits my compression needs the best, with xz a close second. Compression times are reasonable, but I don't need to ...
JesseTG's user avatar
  • 346
2 votes

Database and Spreadsheet combination

Indeed, combining worksheets and databases, simple scripts are more suitable than Power Query. But easy-to-learn and easy-to-use processing scripts are rare. You can try esProc. I have a small example ...
Jerry's user avatar
  • 1
2 votes

Tool to compare the results of an SQL query on two databases

This tool called "JuxtAPPose" does pretty much does what you mention: Compare query results (can connect to DBs) Can load files instead of a query (e.g. you are validating a report) Costs less than $...
Randy's user avatar
  • 31
2 votes

Open and visually browse large CSV files

I've been using EmEditor for years. Can open practically any size file (up to 248GB realistically) and can split CSV and other delimited text into columns. With tons of other features. There's a ...
BlueGI's user avatar
  • 151
2 votes
Accepted

What database can I use to store data from sensors?

What about RRDtool? github What RRDtool does RRDtool is the OpenSource industry standard, high performance data logging and graphing system for time series data. RRDtool can be easily integrated in ...
knb's user avatar
  • 2,754
2 votes

Excel problem: protect sensible data of users and protect my formulas

1. Web-App I convert my file to a web solution To convert you Excel file into a Web-App, I think the link you posted has many solutions that are worth trying. It's hard to tell if they fit your ...
DecimalTurn's user avatar
2 votes

Recovering an important Excel file after formatting disk

Sorry to hear about this. The primary downside to modern SSDs is that data recovery from them is typically very difficult (and often impossible without spending large sums of money). Normal recovery ...
End Anti-Semitic Hate's user avatar
1 vote

internet data scraping tools

The answer depends on your skills. I would tell the problem to my friend ruby. She probably will use mechanize to do the job. If you need some guidance, consult the search engine of your choice for ...
mvw's user avatar
  • 136
1 vote

Online data storage solution for large files

Ordered by price: Hubic 10TB for €5/month, no transfer fees, bandwidth is about 6 MB/s Backblaze unlimited for $5/month, keeps historical files for 30 days Owning 6TB for about €200, excl. price for ...
Vlastimil Ovčáčík's user avatar
1 vote

Which compression utility should I use for an extremely large plain text file?

I would seriously consider taking a look at the HDF5 format as it is specifically designed for this sort of use-case. Details of supported compression formats can be found here but include pre-defined ...
Steve Barnes's user avatar
  • 31.5k
1 vote

Open source GUI tool for data wrangling with little or no programming

I suggest you to use OpenRefine. You first need to add a new column based on the ID and NAME columns, e.g. using this expression: cells["ID"].value + ";" + cells["NAME"].value Sorting by the new ...
myrdd's user avatar
  • 131
1 vote

Database Reporting Software - no SQL skills

You should probably leave your MS-SSQS Datawarehouse to your database admin and link it with an ODBC connection to something more user friendly to handle your datamarts like airtable. Zapier ...
Vincent Tang's user avatar
1 vote

Tool to generate beautiful PDF's from a list of data?

It may be worth looking at Docmosis which works from Word or Open Document Text (ODT) templates and can create PDF results. Since you are creating beautiful (brochure style maybe) PDFs, then ODT is a ...
Paul Jowett's user avatar
1 vote

Dataset insights software

This is the sort of think that the python data exploration and visualization tool chain Pandas is excellent for - you will have to do a little exploring of the data yourself but you will be amazed at ...
Steve Barnes's user avatar
  • 31.5k
1 vote

Software library or tool to pivot and export a lot of data to Excel

While I haven't done this exact sort of thing myself I would recommend installing Python and Pandas. This combination can: Directly query your database(s) Perform pivots with a little care on ...
Steve Barnes's user avatar
  • 31.5k
1 vote

Spreadsheet software analog whitch separates Data from Presentation

There is a python based spreadsheet pyspread that is able to use python code directly in each cell, in fact each cell can contain a complete python program, that you might like to take a look at. But ...
Steve Barnes's user avatar
  • 31.5k
1 vote

Android app to show what apps/processes are currently using data

Since there was no answer posted yet, I decided to include it anyway. Currently the best option of achieving that is using Network Connections as Izzy rightly suggested (and I happen to use the same ...
xavier_fakerat's user avatar
1 vote

Filesharing between two Windows 10 devices in different networks

Ok, from my understanding you want to share easily transfer files between your 2 machines, from a same network which is ( indirectly connected), but have you checked if the networks use the same ...
xavier_fakerat's user avatar
1 vote

How do you create a parent-child tree with table/excel data?

I solved, perhaps, slightly different case with tree representation on Confluence pages with https://bobswift.atlassian.net/wiki/display/GVIZ/Digraph+Macro plugin that can take a table as a source.
user33053's user avatar
1 vote
Accepted

Windows app that aids in making "ORDERED LISTS"?

I found a cool web-app that dose exactly what I am asking, is free and doesn't even require registration... I hope it helps anyone else looking at this question. - http://listmoz.com
aJynks's user avatar
  • 163
1 vote

Field Data Collection and Automation

My company recently started using OFSpro for exactly what you are saying you are in need of. It is a great software for managing field services. The other thing we love about it is that they have an ...
Jared's user avatar
  • 11

Only top scored, non community-wiki answers of a minimum length are eligible