Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data]

The tag has no usage guidance.

0
votes
0answers
9 views

Equivalent to telnet but displays 30 columns of hex bytes

I recently downloaded uCsim, which is a multi-processor simulator and since it works better for me than other simulators I have used in the past, I want to use additional features other simulators ...
1
vote
0answers
5 views

Open Source ETL to load ActiveMQ data into a column-oriented database

Can anybody suggest me an open source tool which can integrate with activemq as a source and load data into any columnar database management system like greenplum/cassandra etc. I have analysed ...
0
votes
0answers
5 views

Quickly offloading lots of data to maintain camera procurement speed needed

We are producing Open Source software to assist in early cancer detection. There are dual scanning cameras snapping pictures at 400 images/second. Each image is 2752px x 2200px. Currently running ...
0
votes
0answers
8 views

What can i use to implement a data lake?

i am a final year student and i am working on my final year project that consist of implementing a system that automate data management. and for that i am planning to use a data lake to store raw ...
2
votes
1answer
27 views

internet data scraping tools

I'm a little distressed, for my job I need to get some info from a website, specifically http://www.museumsusa.org/museums/ , I need for every museum in America to get the name, address, phone number ...
0
votes
0answers
16 views

Python to transfrom data

I have to transform data coming from several sources into a standard csv template. Each source provides either Excel (xlsx), text (csv) or xml files. The task consists in rearrange the data into a ...
1
vote
0answers
7 views

Extracting tabular data from HTML pages

I need to examine an HTML page with a listing of multiple items (people, media files etc.) - having some elements of data per item: Links, numbers, strings etc. - and placing the results in a plain, ...
1
vote
0answers
22 views

State synchronization in distributed systems

Are there any frameworks or technologies to synchronize State/data updated on one peer with all other peers in a reliable network? I'm looking for key-val data and State information that will be ...
0
votes
0answers
9 views

WordPress plugin to show user data for specific user

I'm building a website with WordPress. I need user to look their own data when they have been log in.I would like to know which plugin should I use.I can only find plugins which are showing all user ...
0
votes
0answers
14 views

Data Collection App

I need a recommendation for a data collection app that works like the following. In the perfect world this is how it would function: It would run on a tablet It would have a kiosk mode so only that ...
2
votes
0answers
27 views

Open-source framework for online data presentation

I'm looking for a sort of free framework or base software to develop a web application with the following features: interactively present data (tables and visualisations) that are automatically ...
1
vote
0answers
9 views

Serial port Data generation with automatic checksum

I created a system with a microcontroller (part# AT89S52) in which data can be transferred between any set of devices via a wireless serial port. I have created a data format thats similar to UDP ...
0
votes
0answers
14 views

Real-Time Personally Identifiable Information (PII) Detection

I have a project that involves free text user input (strings of less than 80 characters) and I need to detect PII within that string. This all needs to happen in real-time as we need to send a ...
0
votes
0answers
9 views

What managed OLAP providers are popular these days?

I'm looking for an OLAP system that's managed by a third party so that our ops team doesn't have to deal with it. Unfortunately, it looks like all the options listed here are super enterprisey and way ...
1
vote
0answers
22 views

Appendable numeric file format?

I'm writing some remote monitoring software in Python 3. I currently gzip CSV data collected over about 8 hours for transmission to the server but I'm looking for something with lower bandwidth ...
4
votes
1answer
56 views

Webmail provider that allows easy data migration from Yahoo Mail

Experts have expressed strong concern regarding Yahoo Mail's privacy policy as it is being changed by their new parent company, Oath. The typical recommendation is to switch to a different webmail ...
0
votes
1answer
38 views

Secure data transfer (for DB/ETL)

Does anyone know of any tool, ETL suite or BI suite that enables safe and secure data transfer from one location to another, over internet to an offsite database in the cloud? Or, what approaches ...
3
votes
2answers
97 views

Which compression utility should I use for an extremely large plain text file?

I have a lot of data. A lot. My data file is a little under 2TB (terabytes) of line-separated plain text records, each about 4 or 5 KB (totaling to a few hundred million records). I'm prioritizing ...
0
votes
1answer
109 views

Open source GUI tool for data wrangling

OK, so a programming-challenged analyst has data like this: ID NAME DATE SYSID-1054 XYZ 1 SYSID-1054 XYZ 2 SYSID-1054 OPQ 3 SYSID-1054 OPQ 4 SYSID-1054 XYZ 5 ...
1
vote
0answers
15 views

Random test data generator basis specific fields

Can anyone suggest me a website that can generate random data with filters like State and city. I would like to have some test data for my application testing that needs, Name;Address;PhoneNo;Latitude;...
1
vote
2answers
78 views

Database Reporting Software - no SQL skills

I am looking to find the a tool that lets end users with no database knowledge and SQL experience the capability to create reports that provide both raw data and aggregate information. Requirements ...
2
votes
1answer
72 views

Tool to generate beautiful PDF's from a list of data?

We need to generate a lot of PDF files, based on a simple template (preferably one we can make ourself, but an existing library could work too). Each time we need to input 5-10 data. We would of ...
1
vote
0answers
39 views

Database and Spreadsheet combination

Is there any software that combines spreadsheet and database engine functionality? I would like to be able to paste two tables (for example results of SQL queries, with 20+ different columns each) ...
1
vote
1answer
39 views

Online data storage solution for large files

I have two VeraCrypt containers totaling 5.3tb (3tb and 2.3tb) which I would like to copy to an external location (cloud storage, rented data center space or similar), in case of local loss of data. I ...
1
vote
0answers
16 views

Is there any software which makes my Data entry as well as error correction jobs easier?

Actually, I just need a software solution for my new startup company. Its a data entry company and I just want to convert hand written font characters to Times New Roman italics and so on. It must ...
3
votes
1answer
42 views

App to quickly and easily transfer small amount of data from Windows to Android

I'm looking for an app to quickly and easily transfer a small amount of data from Windows to Android. It would be great if it also worked in the other direction. By "small amount of data", I mean ...
1
vote
0answers
39 views

Generate ETL for many (173) delimited database files

I get a zip of 173 database files, in a delimited format, each day. We call this extract DbUnload. The company that sends me this file, won't adjust the file spec or give me notification of any ...
-2
votes
2answers
32 views

Software to edit large raw datasets easily for PostgreSQL imports?

I have a few lists of 2 million rows or so consisting of: Name, Address, Phone Number but these have errors like multiple commas in a row. When I import these into postgres as .txt and comma ...
2
votes
0answers
54 views

Human-readable format for storing key–value pairs

I am looking for a format to write key–value pairs, where keys and values are delimited by colons. The values either: follow immediately after the colon (whitespace between the colon and the first ...
2
votes
0answers
31 views

A tool for converting date copy into date format

Is there a certain software which would take in a date as a string (Thursday, May 18, 2017 6:30:28am) and output something like 'dddd, MMMM Do YYYY, h:mm:ss a' (moment.js format in this case, strftime ...
0
votes
3answers
59 views

Linux/Windows app for graphing very large amounts of data

I'm looking for something that will allow me to graph 50K+ data points on a Cartesian plane, preferably with lots of setting and options for colors, etc. Note that at this load, LibreOffice crashes. ...
0
votes
1answer
56 views

Spreadsheet software analog whitch separates Data from Presentation

Microsoft Excel mixes formating, presentation and data, that drives me crazy. I just can't use my poor data this way. Is there a tool which works with data and tunes its reporting separately? I can ...
3
votes
2answers
79 views

Android app to show what apps/processes are currently using data

What Android app shows, in real-time, what apps and processes are currently transmitting and receiving data? I am interested in quantity of data being transmitted (not speed). Recommendations for ...
0
votes
1answer
27 views

Filesharing between two Windows 10 devices in different networks

I am trying to find a good way to share or move files and folders between two Windows 10 Pro devices. My setup looks like this: My Laptop is connected through WiFi to the company network. My Desktop ...
0
votes
0answers
31 views

Comparing large datasets (up to 100m)

I am working on a data comparison tool in C#. It takes data from two systems, stores them in a local cache (with a unique primary key, some XML and a record number) and run some checks afterwards. ...
0
votes
2answers
8k views

How do you create a parent-child tree with table/excel data?

I'm using access to model a relational database. I have the following data in a 2 column format: The result should generate a tree/bullet point diagram that looks like this: A B C D G E F ...
1
vote
0answers
27 views

Enter data automatically into a web pages

I have a job to enter data into web pages everyday at specific times, these data are not fixed so is there a software I configure or program to enter the data for me automatically each day ? The data ...
0
votes
0answers
37 views

Good file format for dumping and comparing large amounts of structured data

I'm on the lookout for a suitable file format and a comparison tool that my organization can use to compare large amounts of structured data. The data in question comes from an object-oriented ...
2
votes
1answer
34 views

Field Data Collection and Automation

My company deals with Close Interval Surveys. We are trying to limit the time spent in the office compiling reports once the source data is collected from the field. My question, is there some type of ...
1
vote
3answers
65 views

Software to plot and pan/zoom to analyse

I have a couple days worth of pressure and temperature data from several sensors that I would like to analyse by plotting all of the data in one graph. The reason I would like to see all of it is to ...
1
vote
2answers
51 views

What programming language should I use to generate word lists of Google Ngram raw data

I want to download a portion of data from Google Ngram's corpora and run tests. The data will likely approach 500 gigs (which would almost fill up my hard drive...) I normally use Excel VBA for this ...
1
vote
0answers
132 views

Simple structured data/note management tool

I have a project for which I need to add structured data and then be able to filter and sort for display or export. The data will have mostly single-valued key:value pairs - usually alphanumeric ...
1
vote
0answers
127 views

Gratis data scraping tool to replace Import.io

I need to be able to scrape data from multiple websites regularly. Some coding is OK, but due to heavily constrained time the fewer things I have to learn like XPath, the better. I used to use Import....
1
vote
0answers
21 views

Solutions to transparently locally cache backend data for Android app

As I'm writing my app, I quickly realized I need to have a local cache to avoid too many backend roundtrips. I started building my own from scratch backed by SQLLite with server backend being GAE (...
1
vote
0answers
31 views

Backup for windows VMs and Data

My Setup Lab1 Server has two drives M: Data around 1.7GB V: VMWare Virtual Machines around 2GB Z: I use this drive to backup both M: and V: i used Windows Servers backup, a Full backup takes 24+...
3
votes
1answer
44 views

Dataset insights software

If I have a set of data in whatever format, CSV, JSON, etc. I wanted to throw it at machine learning algorithms and be able to extract some correlation facts from these datasets. Some of the things ...
3
votes
0answers
39 views

Extract data from photos of a physical meter

Looking for a software package that can extract data from a series of photos of a physical meter. Most gauges (e.g. thermometers, barometers, pressure gauges) are inexpensive and provide accurate, ...
1
vote
0answers
35 views

Regression Disconuity Design (RDD) fixed effects multiple cutoffs

With a RDD that has multiple cutoffs and fixed effects by individual, is there an R package that can be used to either 'normalise' or provide relevant propensity score weights? Bertanha "Regression ...
5
votes
2answers
109 views

Stop logging to files. But what system to choose?

Logging to files works since the unix epoch 1970. I think it is time for a change. My reasons: rotating files is a pain: Server needs to get reloaded after rotating ... logging structured data ...
0
votes
0answers
29 views

Online data-entry interface for coding

Our research project is going to code some 20,000 documents on 10-15 variables, such as topic, type, and so on. Coding is going to be done mainly by RAs. We would like to streamline the coding and ...