4
votes
Stop logging to files. But what system to choose?
You might want to log to SQLite databases instead of plain text files for the following reasons:
SQLite is part of the python standard runtime library. Thus, databases can be created, filled and ...
- 421
4
votes
Accepted
Stop logging to files. But what system to choose?
You might be able to use:
https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elk-stack-on-ubuntu-14-04
Logstash forwards the logs to the central logging ...
- 1,726
3
votes
Tool to compare the results of an SQL query on two databases
There is a tool called SelectCompare that allows you to compare two queries.
SelectCompare allows to create comparison projects, which define queries against any two data sources that can be ...
- 41
3
votes
Undelete tools for Windows with high recovery rates
I have used Recuva to recover deleted files on Windows boxes.
It generally works well. It's easy to use, and has a minimal learning curve.
My big complaint with it is that for years they offered a ...
- 6,716
2
votes
Accepted
Scanning multiple choices answers from paper
If you are interesting in creating an application that can do this, I reccomend checking out the LEADTOOLS Forms Recognition SDK. This SDK has C DLL and .NET libraries for OMR recognition. The .NET ...
- 186
2
votes
Backup/restore data multiple sets of data for selected Android apps
Helium - App Sync and Backup (originally named Carbon) has a gratis version and can do that:
Helium (source: Google Play; click images for larger variants)
It's quite a while since I last used it ...
Izzy♦
- 18.9k
2
votes
App to quickly and easily transfer small amount of data from Windows to Android
I would suggest an arbitrary combination of a Windows QR code generator (that can encode arbitrary portions of text) and an Android QR code reader app. I use this combination for exactly the same ...
- 689
2
votes
Linux/Windows app for graphing very large amounts of data
On linux, you might find gnuplot to be useful.
- 121
2
votes
Accepted
What programming language should I use to generate word lists of Google Ngram raw data
Python is quick and easy to learn plus there are domain specific tools for what you are trying to do as a part of the sci-kit learn package including being able to extract a corpus from an on-line ...
- 31.5k
2
votes
Accepted
Which compression utility should I use for an extremely large plain text file?
I've decided to go with Zstandard. I don't have exact numbers on hand, but this suits my compression needs the best, with xz a close second. Compression times are reasonable, but I don't need to ...
- 346
2
votes
Database and Spreadsheet combination
Indeed, combining worksheets and databases, simple scripts are more suitable than Power Query. But easy-to-learn and easy-to-use processing scripts are rare. You can try esProc. I have a small example ...
- 1
2
votes
Tool to compare the results of an SQL query on two databases
This tool called "JuxtAPPose" does pretty much does what you mention:
Compare query results (can connect to DBs)
Can load files instead of a query (e.g. you are validating a report)
Costs less than $...
- 31
2
votes
Open and visually browse large CSV files
I've been using EmEditor for years. Can open practically any size file (up to 248GB realistically) and can split CSV and other delimited text into columns. With tons of other features.
There's a ...
- 151
2
votes
Accepted
What database can I use to store data from sensors?
What about RRDtool? github
What RRDtool does
RRDtool is the OpenSource industry standard, high performance data logging and
graphing system for time series data. RRDtool can be easily integrated in ...
- 2,754
2
votes
Excel problem: protect sensible data of users and protect my formulas
1. Web-App
I convert my file to a web solution
To convert you Excel file into a Web-App, I think the link you posted has many solutions that are worth trying. It's hard to tell if they fit your ...
- 186
2
votes
Recovering an important Excel file after formatting disk
Sorry to hear about this.
The primary downside to modern SSDs is that data recovery from them is typically very difficult (and often impossible without spending large sums of money).
Normal recovery ...
- 6,716
1
vote
internet data scraping tools
The answer depends on your skills.
I would tell the problem to my friend ruby.
She probably will use mechanize to do the job.
If you need some guidance, consult the search engine of your choice for ...
- 136
1
vote
Online data storage solution for large files
Ordered by price:
Hubic 10TB for €5/month, no transfer fees, bandwidth is about 6 MB/s
Backblaze unlimited for $5/month, keeps historical files for 30 days
Owning 6TB for about €200, excl. price for ...
1
vote
Which compression utility should I use for an extremely large plain text file?
I would seriously consider taking a look at the HDF5 format as it is specifically designed for this sort of use-case. Details of supported compression formats can be found here but include pre-defined ...
- 31.5k
1
vote
Open source GUI tool for data wrangling with little or no programming
I suggest you to use OpenRefine.
You first need to add a new column based on the ID and NAME columns, e.g. using this expression:
cells["ID"].value + ";" + cells["NAME"].value
Sorting by the new ...
- 131
1
vote
Database Reporting Software - no SQL skills
You should probably leave your MS-SSQS Datawarehouse to your database admin and link it with an ODBC connection to something more user friendly to handle your datamarts like airtable. Zapier ...
- 381
1
vote
Tool to generate beautiful PDF's from a list of data?
It may be worth looking at Docmosis which works from Word or Open Document Text (ODT) templates and can create PDF results. Since you are creating beautiful (brochure style maybe) PDFs, then ODT is a ...
- 205
1
vote
Dataset insights software
This is the sort of think that the python data exploration and visualization tool chain Pandas is excellent for - you will have to do a little exploring of the data yourself but you will be amazed at ...
- 31.5k
1
vote
Software library or tool to pivot and export a lot of data to Excel
While I haven't done this exact sort of thing myself I would recommend installing Python and Pandas.
This combination can:
Directly query your database(s)
Perform pivots with a little care on ...
- 31.5k
1
vote
Spreadsheet software analog whitch separates Data from Presentation
There is a python based spreadsheet pyspread that is able to use python code directly in each cell, in fact each cell can contain a complete python program, that you might like to take a look at.
But ...
- 31.5k
1
vote
Android app to show what apps/processes are currently using data
Since there was no answer posted yet, I decided to include it anyway.
Currently the best option of achieving that is using Network Connections as Izzy rightly suggested (and I happen to use the same ...
- 820
1
vote
Filesharing between two Windows 10 devices in different networks
Ok, from my understanding you want to share easily transfer files between your 2 machines, from a same network which is ( indirectly connected), but have you checked if the networks use the same ...
- 820
1
vote
How do you create a parent-child tree with table/excel data?
I solved, perhaps, slightly different case with tree representation on Confluence pages with https://bobswift.atlassian.net/wiki/display/GVIZ/Digraph+Macro plugin that can take a table as a source.
- 11
1
vote
Accepted
Windows app that aids in making "ORDERED LISTS"?
I found a cool web-app that dose exactly what I am asking, is free and doesn't even require registration... I hope it helps anyone else looking at this question. - http://listmoz.com
- 163
1
vote
Field Data Collection and Automation
My company recently started using OFSpro for exactly what you are saying you are in need of. It is a great software for managing field services. The other thing we love about it is that they have an ...
- 11
Only top scored, non community-wiki answers of a minimum length are eligible