Questions tagged [data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
4 views

Simple open source data lake or similar SW enabling sharing largish datasets

I need to share the datasets among various (software) servers (developed by other teams). Server A for instance can do text normalization, another server can do e.g. sentiment analysis, yet another ...
0
votes
0answers
8 views

Data correlation tool for personal use

I am interested in finding correlation between different personal daily activities and results. By daily activities, I mean things like: Duration of exercise Duration of sleep Duration of meditation ...
0
votes
0answers
14 views

Azure Data Factory Labs (Collecting data from RestAPi)

I think that this question may have been asked previously, but this was a few years ago. Does anybody know if Microsoft have an online lab of sorts to be able to use Azure Data Factory. I am ...
1
vote
0answers
12 views

Software to get FOREX data in CSV format

Could you guys recommend me a software that can: Download today's FOREX data only. Forex Currencies must contain Peso, Yen, Chinese yuan (Please correct me if I'm wrong), Euro. (If it can be modified,...
0
votes
0answers
5 views

Automatic Data Recovery bootable USB

I'm looking for a way to make a bootable USB that automatically (without any user interaction) try to recover a specific directory on a Computer that crashed and can't start. Then, make a copy of the ...
0
votes
0answers
4 views

Redundant, realtime data storage/streaming/logging for maximum data security

I am going to set up an experiment with plenty of sensors, an Raspberry-PI (most probably) with Linux for a long duration experiment with chances of data corruption and/or reboot due to ionization ...
0
votes
0answers
12 views

Simple tools to use for distributed stateful processing

I'm wondering which simple tools could help me implementing a standard Master <-> N Workers stateful job dispatch in Java. Master would be polling jobs from a broker and distributing it to worker ...
0
votes
0answers
5 views

Are there any .NET-based streaming data stacks?

I work in a shop that is big-data-ish. Historically we've been a .NET shop but in the last few years we've added Kafka, Hadoop, Storm, and Spark -- all based on the JVM. I have no interest in ...
0
votes
0answers
2 views

Does anyone know about a program extracting data from Instagram?

as I'm currently writing my master thesis in communication sciences, I'd need to know if there is any program extracting data from public Instagram accounts (followers, pictures, likes, comments, ...
0
votes
0answers
14 views

Sync Postgres db from local to cloud

Here is my use case: Data source: I have several Postgres databases which are stored locally. Data destination: I would like to collect the data from all these sources and store them in a central ...
0
votes
0answers
11 views

Hosting Data Online with CORS

I'm looking for a way I can host data files online (CSV, JSON) that is CORS enabled. Does such a thing exist online? Ideally I would like the solution to be free and not to involve a lot of ...
1
vote
0answers
3 views

What software can one use to create a data graph out of a website?

i want to extract all the data from a website, and the data is rendered as a data graph. So how can i go about extracting it and saving to an excel or database?
0
votes
0answers
9 views

Equivalent to telnet but displays 30 columns of hex bytes

I recently downloaded uCsim, which is a multi-processor simulator and since it works better for me than other simulators I have used in the past, I want to use additional features other simulators ...
1
vote
0answers
17 views

Open Source ETL to load ActiveMQ data into a column-oriented database

Can anybody suggest me an open source tool which can integrate with activemq as a source and load data into any columnar database management system like greenplum/cassandra etc. I have analysed ...
2
votes
1answer
37 views

internet data scraping tools

I'm a little distressed, for my job I need to get some info from a website, specifically http://www.museumsusa.org/museums/ , I need for every museum in America to get the name, address, phone number ...
2
votes
0answers
85 views

State synchronization in distributed systems

Are there any frameworks or technologies to synchronize State/data updated on one peer with all other peers in a reliable network? I'm looking for key-val data and State information that will be ...
2
votes
0answers
28 views

Open-source framework for online data presentation

I'm looking for a sort of free framework or base software to develop a web application with the following features: interactively present data (tables and visualisations) that are automatically ...
1
vote
0answers
10 views

Serial port Data generation with automatic checksum

I created a system with a microcontroller (part# AT89S52) in which data can be transferred between any set of devices via a wireless serial port. I have created a data format thats similar to UDP ...
1
vote
0answers
34 views

Appendable numeric file format?

I'm writing some remote monitoring software in Python 3. I currently gzip CSV data collected over about 8 hours for transmission to the server but I'm looking for something with lower bandwidth ...
4
votes
1answer
64 views

Webmail provider that allows easy data migration from Yahoo Mail

Experts have expressed strong concern regarding Yahoo Mail's privacy policy as it is being changed by their new parent company, Oath. The typical recommendation is to switch to a different webmail ...
0
votes
1answer
45 views

Secure data transfer (for DB/ETL)

Does anyone know of any tool, ETL suite or BI suite that enables safe and secure data transfer from one location to another, over internet to an offsite database in the cloud? Or, what approaches ...
4
votes
2answers
139 views

Which compression utility should I use for an extremely large plain text file?

I have a lot of data. A lot. My data file is a little under 2TB (terabytes) of line-separated plain text records, each about 4 or 5 KB (totaling to a few hundred million records). I'm prioritizing ...
0
votes
1answer
174 views

Open source GUI tool for data wrangling

OK, so a programming-challenged analyst has data like this: ID NAME DATE SYSID-1054 XYZ 1 SYSID-1054 XYZ 2 SYSID-1054 OPQ 3 SYSID-1054 OPQ 4 SYSID-1054 XYZ 5 ...
1
vote
0answers
17 views

Random test data generator basis specific fields

Can anyone suggest me a website that can generate random data with filters like State and city. I would like to have some test data for my application testing that needs, Name;Address;PhoneNo;Latitude;...
1
vote
2answers
88 views

Database Reporting Software - no SQL skills

I am looking to find the a tool that lets end users with no database knowledge and SQL experience the capability to create reports that provide both raw data and aggregate information. Requirements ...
2
votes
1answer
77 views

Tool to generate beautiful PDF's from a list of data?

We need to generate a lot of PDF files, based on a simple template (preferably one we can make ourself, but an existing library could work too). Each time we need to input 5-10 data. We would of ...
1
vote
0answers
55 views

Database and Spreadsheet combination

Is there any software that combines spreadsheet and database engine functionality? I would like to be able to paste two tables (for example results of SQL queries, with 20+ different columns each) ...
1
vote
1answer
42 views

Online data storage solution for large files

I have two VeraCrypt containers totaling 5.3tb (3tb and 2.3tb) which I would like to copy to an external location (cloud storage, rented data center space or similar), in case of local loss of data. I ...
1
vote
0answers
17 views

Is there any software which makes my Data entry as well as error correction jobs easier?

Actually, I just need a software solution for my new startup company. Its a data entry company and I just want to convert hand written font characters to Times New Roman italics and so on. It must ...
3
votes
1answer
43 views

App to quickly and easily transfer small amount of data from Windows to Android

I'm looking for an app to quickly and easily transfer a small amount of data from Windows to Android. It would be great if it also worked in the other direction. By "small amount of data", I mean ...
1
vote
0answers
46 views

Generate ETL for many (173) delimited database files

I get a zip of 173 database files, in a delimited format, each day. We call this extract DbUnload. The company that sends me this file, won't adjust the file spec or give me notification of any ...
-2
votes
2answers
38 views

Software to edit large raw datasets easily for PostgreSQL imports?

I have a few lists of 2 million rows or so consisting of: Name, Address, Phone Number but these have errors like multiple commas in a row. When I import these into postgres as .txt and comma ...
2
votes
0answers
63 views

Human-readable format for storing key–value pairs

I am looking for a format to write key–value pairs, where keys and values are delimited by colons. The values either: follow immediately after the colon (whitespace between the colon and the first ...
2
votes
0answers
32 views

A tool for converting date copy into date format

Is there a certain software which would take in a date as a string (Thursday, May 18, 2017 6:30:28am) and output something like 'dddd, MMMM Do YYYY, h:mm:ss a' (moment.js format in this case, strftime ...
0
votes
3answers
61 views

Linux/Windows app for graphing very large amounts of data

I'm looking for something that will allow me to graph 50K+ data points on a Cartesian plane, preferably with lots of setting and options for colors, etc. Note that at this load, LibreOffice crashes. ...
0
votes
1answer
57 views

Spreadsheet software analog whitch separates Data from Presentation

Microsoft Excel mixes formating, presentation and data, that drives me crazy. I just can't use my poor data this way. Is there a tool which works with data and tunes its reporting separately? I can ...
3
votes
2answers
96 views

Android app to show what apps/processes are currently using data

What Android app shows, in real-time, what apps and processes are currently transmitting and receiving data? I am interested in quantity of data being transmitted (not speed). Recommendations for ...
0
votes
1answer
28 views

Filesharing between two Windows 10 devices in different networks

I am trying to find a good way to share or move files and folders between two Windows 10 Pro devices. My setup looks like this: My Laptop is connected through WiFi to the company network. My Desktop ...
0
votes
0answers
34 views

Comparing large datasets (up to 100m)

I am working on a data comparison tool in C#. It takes data from two systems, stores them in a local cache (with a unique primary key, some XML and a record number) and run some checks afterwards. ...
0
votes
2answers
15k views

How do you create a parent-child tree with table/excel data?

I'm using access to model a relational database. I have the following data in a 2 column format: The result should generate a tree/bullet point diagram that looks like this: A B C D G E F ...
1
vote
0answers
30 views

Enter data automatically into a web pages

I have a job to enter data into web pages everyday at specific times, these data are not fixed so is there a software I configure or program to enter the data for me automatically each day ? The data ...
0
votes
0answers
40 views

Good file format for dumping and comparing large amounts of structured data

I'm on the lookout for a suitable file format and a comparison tool that my organization can use to compare large amounts of structured data. The data in question comes from an object-oriented ...
2
votes
1answer
36 views

Field Data Collection and Automation

My company deals with Close Interval Surveys. We are trying to limit the time spent in the office compiling reports once the source data is collected from the field. My question, is there some type of ...
1
vote
3answers
77 views

Software to plot and pan/zoom to analyse

I have a couple days worth of pressure and temperature data from several sensors that I would like to analyse by plotting all of the data in one graph. The reason I would like to see all of it is to ...
1
vote
2answers
52 views

What programming language should I use to generate word lists of Google Ngram raw data

I want to download a portion of data from Google Ngram's corpora and run tests. The data will likely approach 500 gigs (which would almost fill up my hard drive...) I normally use Excel VBA for this ...
1
vote
0answers
133 views

Simple structured data/note management tool

I have a project for which I need to add structured data and then be able to filter and sort for display or export. The data will have mostly single-valued key:value pairs - usually alphanumeric ...
1
vote
0answers
140 views

Gratis data scraping tool to replace Import.io

I need to be able to scrape data from multiple websites regularly. Some coding is OK, but due to heavily constrained time the fewer things I have to learn like XPath, the better. I used to use Import....
1
vote
0answers
21 views

Solutions to transparently locally cache backend data for Android app

As I'm writing my app, I quickly realized I need to have a local cache to avoid too many backend roundtrips. I started building my own from scratch backed by SQLLite with server backend being GAE (...
1
vote
0answers
34 views

Backup for windows VMs and Data

My Setup Lab1 Server has two drives M: Data around 1.7GB V: VMWare Virtual Machines around 2GB Z: I use this drive to backup both M: and V: i used Windows Servers backup, a Full backup takes 24+...
3
votes
1answer
47 views

Dataset insights software

If I have a set of data in whatever format, CSV, JSON, etc. I wanted to throw it at machine learning algorithms and be able to extract some correlation facts from these datasets. Some of the things ...