Questions tagged [data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
-2
votes
0answers
4 views

Multithreading or multiprocessing [on hold]

Hi stackoverflow community, I built a time series model to forecast sales, and I need to run my model for several establishments individually. I want to automate the process, i.e running the models ...
-1
votes
0answers
3 views

how to design and implement layers in hadoop datalake?

Thanks in advance. I would like to know how to implement the different layers in Hadoop Datalake. Please suggest on raw layer, raw viewable, confirmed, consumption layers. Are they differ by folders?...
0
votes
0answers
4 views

Help me find a software to add addresses to a list with names, cities, states, and zipcodes?

I need a software in which I can upload a person's first name, last name, city, state, and zip-code, and have the software automatically add the person's address. I have found services that can ...
-2
votes
0answers
7 views

What is an appropriate data structure for streaming data and remembering the last N messages? [closed]

I have a stream of messages coming in and I only need save/cache the 5 most recent messages to do some real time processing with. I'd like to place a limit on cache size so when it exceeds the amount, ...
-1
votes
0answers
13 views

Open source or affordable data profiling tool

Good day, How do you do data profiling? I am looking for the tool using https://www.google.com/search?q=data+profiling+open+source&rlz=1C1CHBF_enGH760GH760&ei=kMwlXfKpJcSMlwT5lq-ICg&...
0
votes
0answers
4 views

How to upload bigdata to Hadoop through web application [closed]

How to upload bigdata to Hadoop through web application. 1.The source will be selected by the user using the web application(ex: local files/SQLdb etc). 2.Upload module should support huge files. We ...
0
votes
0answers
3 views

What software I should use to store data on server for mobile games?

Here is a newbie for mobile game development. I want to know what is popularly used to store game data nowadays? DataBase, key-value store or something else? In my case, I need to store shared data ...
0
votes
0answers
15 views

Software to show Tabular Data in Angular based front end application

I am looking for recommendation(both licensed and open source) for a 1. Tool/software to show large tabular data in my Angular application, 2. Showing the bar chart against each filter option. I ...
0
votes
0answers
3 views

ADLS Gen1 to Gen2 migration using Azure Data Factory - Copy Data Activity [closed]

How can we estimate the time taken for: ADLS Gen1 to Gen2 migration using Azure Data Factory - Copy Data Activity for 80TB Data. What are the best practices other than using Azure Data Factory to ...
0
votes
0answers
2 views

Switching off data automatically

Is there any app which can switch off mobile data automatically. I tend to forget to switch off Mobile Data , after I'm done with the use and I am looking for something that can switch it off ...
0
votes
0answers
4 views

Stock data for chart creation

Are there any free APIs or low cost data I could get that would have stock ticker date, open, high, low, close and volume so I could create 1 min to 1 day candle stick chart? NASDAQ, NYSE, etc..
1
vote
0answers
4 views

Analyze Websites for Key Words

I'd like to analyze Github and other websites for the prevelancy of certain key words. How would I go about doing this? The solution must be able to complete the following: Check for the occurrence ...
0
votes
0answers
8 views

entity - relationship builder software

i'm looking for some kind of software that would let me create "entities" (people, places, things, etc) with different characteristics (to be set by me) and tags. Then the software should be able to ...
1
vote
1answer
24 views

Prepare dataset in CSV for machine learning?

I have a dataset consisting of CSV files (weather data). My issue is to clean the wrong values or empty values before using the dataset for machine learning. Right now I have to copy by hand the data ...
1
vote
0answers
5 views

NodeJS package to generate correlated data?

I am looking to create a synthetic database and for that I need to generate some ordinal data that has a correlation, say 0.5. I have seen packages in R to generate correlated ordinal data based on ...
0
votes
0answers
11 views

Recommendations for software, library or framework to delta large CSV Files

I am currently investigating what is out there that would quickly and efficiently compare and produce a delta from CSV Files. What I am dealing with is data that is outputted from Sybase ASE. These ...
0
votes
0answers
4 views

Mulesoft replacement in Azure

In integration layer , mulesoft is used and api's are exposed internal, sources connected to crm, record management, web server & sql server, to replace in Azure, what are components are required? ...
0
votes
0answers
6 views

Where can I find some good examples of hackable data input code?

I'm looking to build a data input programme which can automate the transfer of numbers from a spreadsheet that I receive, to a fixed spreadsheet template. The number of entries on the spreadsheet can ...
0
votes
0answers
4 views

Android SharedPreferences viewer app for devices without root access

I'm looking for an Android SharedPreferences database viewer app that will work with non-rooted devices. Without root access, the app will not be able to edit SharedPreferences data (please correct ...
0
votes
0answers
5 views

Filter, query, and sort data based on fields and tag

Looking for a tool that can help me filter, sort, visualize and query data based on various fields and attributes. Input: All data will have the following similar fields Card Name Power Cost ...
0
votes
0answers
3 views

Easy to use WIndows tool to view HDF5 files and/or convert to CSV

I tried using HDFView (https://www.hdfgroup.org/downloads/hdfview/ ), but it doesn't display the columns clearly. It groups all data columns into an array and removes the column headings when I try ...
0
votes
0answers
17 views

Data reporting tools for NGO

I work with Compassion in World Farming and need your help/advice 🙏 We are trying to decide on the right reporting tool - our data sources include Salesforce Google Analytics Facebook Ads Manager ...
0
votes
0answers
4 views

Data Viz Reporting tool for automatic custom pdf generation

Which Data Viz reporting tool (Tableau, Sisense etc.) is the best if I want to perform automatic pdf generation? Also the pdf components (Cover Page Logo, Background etc) would vary according to the ...
1
vote
0answers
7 views

Is it an ok practice to keep pointers dereferenced? [closed]

For me, I prefer having all my variables, not as pointers. Is it ok to keep all heap-allocated variables dereferenced? For example: #include "Foo.hpp" #include "Bar.hpp" class Foo { private: Bar* ...
0
votes
0answers
8 views

Android SMS backup app that exports SMS messages to plain text

Can anyone recommend an Android SMS backup/export app with the following requirements: Runs on Android (any version) Gratis Exports SMS conversations to one or more plain text (txt) file(s). Not XML,...
1
vote
0answers
9 views

An Open Source or paid tool to generate mock data for unit testing, performance testing and mocking production data

I am looking for a data generation tool that can generate large amounts of data with following requirements. Ability to configure type of data that needs to be generated -- Data has lot of ...
0
votes
0answers
4 views

Simple open source data lake or similar SW enabling sharing largish datasets

I need to share the datasets among various (software) servers (developed by other teams). Server A for instance can do text normalization, another server can do e.g. sentiment analysis, yet another ...
0
votes
0answers
7 views

Data correlation tool for personal use

I am interested in finding correlation between different personal daily activities and results. By daily activities, I mean things like: Duration of exercise Duration of sleep Duration of meditation ...
0
votes
0answers
10 views

Azure Data Factory Labs (Collecting data from RestAPi)

I think that this question may have been asked previously, but this was a few years ago. Does anybody know if Microsoft have an online lab of sorts to be able to use Azure Data Factory. I am ...
1
vote
0answers
11 views

Software to get FOREX data in CSV format

Could you guys recommend me a software that can: Download today's FOREX data only. Forex Currencies must contain Peso, Yen, Chinese yuan (Please correct me if I'm wrong), Euro. (If it can be modified,...
0
votes
0answers
5 views

Automatic Data Recovery bootable USB

I'm looking for a way to make a bootable USB that automatically (without any user interaction) try to recover a specific directory on a Computer that crashed and can't start. Then, make a copy of the ...
0
votes
0answers
4 views

Redundant, realtime data storage/streaming/logging for maximum data security

I am going to set up an experiment with plenty of sensors, an Raspberry-PI (most probably) with Linux for a long duration experiment with chances of data corruption and/or reboot due to ionization ...
0
votes
0answers
11 views

Simple tools to use for distributed stateful processing

I'm wondering which simple tools could help me implementing a standard Master <-> N Workers stateful job dispatch in Java. Master would be polling jobs from a broker and distributing it to worker ...
0
votes
0answers
5 views

Are there any .NET-based streaming data stacks?

I work in a shop that is big-data-ish. Historically we've been a .NET shop but in the last few years we've added Kafka, Hadoop, Storm, and Spark -- all based on the JVM. I have no interest in ...
0
votes
0answers
2 views

Does anyone know about a program extracting data from Instagram?

as I'm currently writing my master thesis in communication sciences, I'd need to know if there is any program extracting data from public Instagram accounts (followers, pictures, likes, comments, ...
0
votes
0answers
11 views

Sync Postgres db from local to cloud

Here is my use case: Data source: I have several Postgres databases which are stored locally. Data destination: I would like to collect the data from all these sources and store them in a central ...
0
votes
0answers
10 views

Hosting Data Online with CORS

I'm looking for a way I can host data files online (CSV, JSON) that is CORS enabled. Does such a thing exist online? Ideally I would like the solution to be free and not to involve a lot of ...
1
vote
0answers
3 views

What software can one use to create a data graph out of a website?

i want to extract all the data from a website, and the data is rendered as a data graph. So how can i go about extracting it and saving to an excel or database?
0
votes
0answers
9 views

Equivalent to telnet but displays 30 columns of hex bytes

I recently downloaded uCsim, which is a multi-processor simulator and since it works better for me than other simulators I have used in the past, I want to use additional features other simulators ...
1
vote
0answers
9 views

Open Source ETL to load ActiveMQ data into a column-oriented database

Can anybody suggest me an open source tool which can integrate with activemq as a source and load data into any columnar database management system like greenplum/cassandra etc. I have analysed ...
0
votes
0answers
5 views

Quickly offloading lots of data to maintain camera procurement speed needed

We are producing Open Source software to assist in early cancer detection. There are dual scanning cameras snapping pictures at 400 images/second. Each image is 2752px x 2200px. Currently running ...
0
votes
0answers
13 views

What can i use to implement a data lake?

i am a final year student and i am working on my final year project that consist of implementing a system that automate data management. and for that i am planning to use a data lake to store raw ...
2
votes
1answer
29 views

internet data scraping tools

I'm a little distressed, for my job I need to get some info from a website, specifically http://www.museumsusa.org/museums/ , I need for every museum in America to get the name, address, phone number ...
0
votes
0answers
16 views

Python to transfrom data

I have to transform data coming from several sources into a standard csv template. Each source provides either Excel (xlsx), text (csv) or xml files. The task consists in rearrange the data into a ...
0
votes
0answers
9 views

Extracting tabular data from HTML pages

I need to examine an HTML page with a listing of multiple items (people, media files etc.) - having some elements of data per item: Links, numbers, strings etc. - and placing the results in a plain, ...
1
vote
0answers
42 views

State synchronization in distributed systems

Are there any frameworks or technologies to synchronize State/data updated on one peer with all other peers in a reliable network? I'm looking for key-val data and State information that will be ...
0
votes
0answers
9 views

WordPress plugin to show user data for specific user

I'm building a website with WordPress. I need user to look their own data when they have been log in.I would like to know which plugin should I use.I can only find plugins which are showing all user ...
0
votes
0answers
15 views

Data Collection App

I need a recommendation for a data collection app that works like the following. In the perfect world this is how it would function: It would run on a tablet It would have a kiosk mode so only that ...
2
votes
0answers
28 views

Open-source framework for online data presentation

I'm looking for a sort of free framework or base software to develop a web application with the following features: interactively present data (tables and visualisations) that are automatically ...
1
vote
0answers
9 views

Serial port Data generation with automatic checksum

I created a system with a microcontroller (part# AT89S52) in which data can be transferred between any set of devices via a wireless serial port. I have created a data format thats similar to UDP ...