Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [data]

The tag has no usage guidance.

0
votes
0answers
6 views

Excel get data from website with login (server is iis (windows 2003)) [on hold]

I try get some data from website to excel. Of course, it's good working before I set additional option for security(login). (I make new account for login) It good working when I try access to .aspx ...
1
vote
0answers
7 views

An Open Source or paid tool to generate mock data for unit testing, performance testing and mocking production data

I am looking for a data generation tool that can generate large amounts of data with following requirements. Ability to configure type of data that needs to be generated -- Data has lot of ...
0
votes
0answers
11 views

Cybersecurity vs Data Science. Which are the pros and cons of cybersecurity and data science? Which one should I prefer? [closed]

I am currently in my bachelor program. I am thinking of specializing in either data science or cybersecurity. I have current experience with backend and ios development. I have done some amount of ...
0
votes
0answers
3 views

Simple open source data lake or similar SW enabling sharing largish datasets

I need to share the datasets among various (software) servers (developed by other teams). Server A for instance can do text normalization, another server can do e.g. sentiment analysis, yet another ...
0
votes
0answers
7 views

Data correlation tool for personal use

I am interested in finding correlation between different personal daily activities and results. By daily activities, I mean things like: Duration of exercise Duration of sleep Duration of meditation ...
0
votes
0answers
10 views

Azure Data Factory Labs (Collecting data from RestAPi)

I think that this question may have been asked previously, but this was a few years ago. Does anybody know if Microsoft have an online lab of sorts to be able to use Azure Data Factory. I am ...
-1
votes
0answers
5 views

Architecture and tools to handle distributed system in Node

I am trying to some up with a suitable plan to create a distributed system that can handle both high bandwidth load + high request number of a single page application. A scenario that would occur in ...
1
vote
0answers
7 views

Software to get FOREX data in CSV format

Could you guys recommend me a software that can: Download today's FOREX data only. Forex Currencies must contain Peso, Yen, Chinese yuan (Please correct me if I'm wrong), Euro. (If it can be modified,...
0
votes
0answers
4 views

Automatic Data Recovery bootable USB

I'm looking for a way to make a bootable USB that automatically (without any user interaction) try to recover a specific directory on a Computer that crashed and can't start. Then, make a copy of the ...
-1
votes
0answers
7 views

Which Method of Pulling Data Would Be Faster?

So I'm trying to design a web app that requires a good amount of data (1,000,000 rows). I want to describe two methodologies of how to pull in and present the data and get recommendations on which ...
0
votes
0answers
4 views

Redundant, realtime data storage/streaming/logging for maximum data security

I am going to set up an experiment with plenty of sensors, an Raspberry-PI (most probably) with Linux for a long duration experiment with chances of data corruption and/or reboot due to ionization ...
0
votes
0answers
10 views

Simple tools to use for distributed stateful processing

I'm wondering which simple tools could help me implementing a standard Master <-> N Workers stateful job dispatch in Java. Master would be polling jobs from a broker and distributing it to worker ...
0
votes
0answers
5 views

Are there any .NET-based streaming data stacks?

I work in a shop that is big-data-ish. Historically we've been a .NET shop but in the last few years we've added Kafka, Hadoop, Storm, and Spark -- all based on the JVM. I have no interest in ...
0
votes
0answers
2 views

Does anyone know about a program extracting data from Instagram?

as I'm currently writing my master thesis in communication sciences, I'd need to know if there is any program extracting data from public Instagram accounts (followers, pictures, likes, comments, ...
0
votes
0answers
9 views

Sync Postgres db from local to cloud

Here is my use case: Data source: I have several Postgres databases which are stored locally. Data destination: I would like to collect the data from all these sources and store them in a central ...
0
votes
0answers
8 views

Hosting Data Online with CORS

I'm looking for a way I can host data files online (CSV, JSON) that is CORS enabled. Does such a thing exist online? Ideally I would like the solution to be free and not to involve a lot of ...
1
vote
0answers
3 views

What software can one use to create a data graph out of a website?

i want to extract all the data from a website, and the data is rendered as a data graph. So how can i go about extracting it and saving to an excel or database?
0
votes
0answers
9 views

Equivalent to telnet but displays 30 columns of hex bytes

I recently downloaded uCsim, which is a multi-processor simulator and since it works better for me than other simulators I have used in the past, I want to use additional features other simulators ...
1
vote
0answers
9 views

Open Source ETL to load ActiveMQ data into a column-oriented database

Can anybody suggest me an open source tool which can integrate with activemq as a source and load data into any columnar database management system like greenplum/cassandra etc. I have analysed ...
0
votes
0answers
5 views

Quickly offloading lots of data to maintain camera procurement speed needed

We are producing Open Source software to assist in early cancer detection. There are dual scanning cameras snapping pictures at 400 images/second. Each image is 2752px x 2200px. Currently running ...
0
votes
0answers
12 views

What can i use to implement a data lake?

i am a final year student and i am working on my final year project that consist of implementing a system that automate data management. and for that i am planning to use a data lake to store raw ...
2
votes
1answer
29 views

internet data scraping tools

I'm a little distressed, for my job I need to get some info from a website, specifically http://www.museumsusa.org/museums/ , I need for every museum in America to get the name, address, phone number ...
0
votes
0answers
16 views

Python to transfrom data

I have to transform data coming from several sources into a standard csv template. Each source provides either Excel (xlsx), text (csv) or xml files. The task consists in rearrange the data into a ...
1
vote
0answers
7 views

Extracting tabular data from HTML pages

I need to examine an HTML page with a listing of multiple items (people, media files etc.) - having some elements of data per item: Links, numbers, strings etc. - and placing the results in a plain, ...
1
vote
0answers
29 views

State synchronization in distributed systems

Are there any frameworks or technologies to synchronize State/data updated on one peer with all other peers in a reliable network? I'm looking for key-val data and State information that will be ...
0
votes
0answers
9 views

WordPress plugin to show user data for specific user

I'm building a website with WordPress. I need user to look their own data when they have been log in.I would like to know which plugin should I use.I can only find plugins which are showing all user ...
0
votes
0answers
14 views

Data Collection App

I need a recommendation for a data collection app that works like the following. In the perfect world this is how it would function: It would run on a tablet It would have a kiosk mode so only that ...
2
votes
0answers
28 views

Open-source framework for online data presentation

I'm looking for a sort of free framework or base software to develop a web application with the following features: interactively present data (tables and visualisations) that are automatically ...
1
vote
0answers
9 views

Serial port Data generation with automatic checksum

I created a system with a microcontroller (part# AT89S52) in which data can be transferred between any set of devices via a wireless serial port. I have created a data format thats similar to UDP ...
0
votes
0answers
16 views

Real-Time Personally Identifiable Information (PII) Detection

I have a project that involves free text user input (strings of less than 80 characters) and I need to detect PII within that string. This all needs to happen in real-time as we need to send a ...
0
votes
0answers
9 views

What managed OLAP providers are popular these days?

I'm looking for an OLAP system that's managed by a third party so that our ops team doesn't have to deal with it. Unfortunately, it looks like all the options listed here are super enterprisey and way ...
1
vote
0answers
25 views

Appendable numeric file format?

I'm writing some remote monitoring software in Python 3. I currently gzip CSV data collected over about 8 hours for transmission to the server but I'm looking for something with lower bandwidth ...
4
votes
1answer
59 views

Webmail provider that allows easy data migration from Yahoo Mail

Experts have expressed strong concern regarding Yahoo Mail's privacy policy as it is being changed by their new parent company, Oath. The typical recommendation is to switch to a different webmail ...
0
votes
1answer
40 views

Secure data transfer (for DB/ETL)

Does anyone know of any tool, ETL suite or BI suite that enables safe and secure data transfer from one location to another, over internet to an offsite database in the cloud? Or, what approaches ...
3
votes
2answers
105 views

Which compression utility should I use for an extremely large plain text file?

I have a lot of data. A lot. My data file is a little under 2TB (terabytes) of line-separated plain text records, each about 4 or 5 KB (totaling to a few hundred million records). I'm prioritizing ...
0
votes
1answer
123 views

Open source GUI tool for data wrangling

OK, so a programming-challenged analyst has data like this: ID NAME DATE SYSID-1054 XYZ 1 SYSID-1054 XYZ 2 SYSID-1054 OPQ 3 SYSID-1054 OPQ 4 SYSID-1054 XYZ 5 ...
1
vote
0answers
16 views

Random test data generator basis specific fields

Can anyone suggest me a website that can generate random data with filters like State and city. I would like to have some test data for my application testing that needs, Name;Address;PhoneNo;Latitude;...
1
vote
2answers
79 views

Database Reporting Software - no SQL skills

I am looking to find the a tool that lets end users with no database knowledge and SQL experience the capability to create reports that provide both raw data and aggregate information. Requirements ...
2
votes
1answer
73 views

Tool to generate beautiful PDF's from a list of data?

We need to generate a lot of PDF files, based on a simple template (preferably one we can make ourself, but an existing library could work too). Each time we need to input 5-10 data. We would of ...
1
vote
0answers
41 views

Database and Spreadsheet combination

Is there any software that combines spreadsheet and database engine functionality? I would like to be able to paste two tables (for example results of SQL queries, with 20+ different columns each) ...
1
vote
1answer
41 views

Online data storage solution for large files

I have two VeraCrypt containers totaling 5.3tb (3tb and 2.3tb) which I would like to copy to an external location (cloud storage, rented data center space or similar), in case of local loss of data. I ...
1
vote
0answers
16 views

Is there any software which makes my Data entry as well as error correction jobs easier?

Actually, I just need a software solution for my new startup company. Its a data entry company and I just want to convert hand written font characters to Times New Roman italics and so on. It must ...
3
votes
1answer
42 views

App to quickly and easily transfer small amount of data from Windows to Android

I'm looking for an app to quickly and easily transfer a small amount of data from Windows to Android. It would be great if it also worked in the other direction. By "small amount of data", I mean ...
1
vote
0answers
41 views

Generate ETL for many (173) delimited database files

I get a zip of 173 database files, in a delimited format, each day. We call this extract DbUnload. The company that sends me this file, won't adjust the file spec or give me notification of any ...
-2
votes
2answers
35 views

Software to edit large raw datasets easily for PostgreSQL imports?

I have a few lists of 2 million rows or so consisting of: Name, Address, Phone Number but these have errors like multiple commas in a row. When I import these into postgres as .txt and comma ...
2
votes
0answers
54 views

Human-readable format for storing key–value pairs

I am looking for a format to write key–value pairs, where keys and values are delimited by colons. The values either: follow immediately after the colon (whitespace between the colon and the first ...
2
votes
0answers
31 views

A tool for converting date copy into date format

Is there a certain software which would take in a date as a string (Thursday, May 18, 2017 6:30:28am) and output something like 'dddd, MMMM Do YYYY, h:mm:ss a' (moment.js format in this case, strftime ...
0
votes
3answers
60 views

Linux/Windows app for graphing very large amounts of data

I'm looking for something that will allow me to graph 50K+ data points on a Cartesian plane, preferably with lots of setting and options for colors, etc. Note that at this load, LibreOffice crashes. ...
0
votes
1answer
57 views

Spreadsheet software analog whitch separates Data from Presentation

Microsoft Excel mixes formating, presentation and data, that drives me crazy. I just can't use my poor data this way. Is there a tool which works with data and tunes its reporting separately? I can ...
3
votes
2answers
82 views

Android app to show what apps/processes are currently using data

What Android app shows, in real-time, what apps and processes are currently transmitting and receiving data? I am interested in quantity of data being transmitted (not speed). Recommendations for ...