Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
30 views

Seeking Insights on PyFlink vs Java API for Apache Flink

I'm currently exploring different options for stream processing and am particularly interested in Apache Flink. I've noticed that Flink supports both PyFlink (Python API) and the Java API, and I'm ...
user87245's user avatar
0 votes
0 answers
15 views

Android application backup software that covers as much data/settings as possible

I'm looking for Android backup software that tries to backup and then restore as much application data/settings as possible, and nothing else: any sort of app data notification settings permissions ...
Destroy666's user avatar
  • 1,892
0 votes
0 answers
10 views

Is it possible to automate the data mining process to automatically generate insights

I'm a Frontend Dev tasked with Data Insights (Help!) Hey everyone! I'm a fresh graduate working as a front-end developer. This is my first real job, and I'm thrown into the deep end a bit! My first ...
Zihan Azad's user avatar
0 votes
0 answers
12 views

Software for Searchable Experiment Archive?

I'm looking into software recommendations for a company that has years and years worth of experiments, and it would be really useful to have all that in one archive which could be searched via a query....
Erin's user avatar
  • 1
0 votes
0 answers
14 views

What tool or third party to use to download a large number of files with proxy to cloud storage

So I have urls of a lot of pdf files from various websites. Like 700k of them. I want to download them to my Google Cloud Bucket. I am getting ip banned from some sites. Thus I was wondering there ...
isa türk's user avatar
  • 101
1 vote
0 answers
8 views

Software for semantic layer in the field of business intelligence

I am currently looking for a business-layer-software or semantic-layer-software to replace SAP business objects. I am working for a data-management team for the public sector. Do you have any ...
paranoia_do's user avatar
1 vote
2 answers
130 views

Recovering an important Excel file after formatting disk

A friend of mine has just deleted partitions on his main disk through the Windows 10 installer, and has reinstalled Windows 10 on his now clean 256GB Samsung SSD. He backed up most of his files, ...
Elyes Lounissi's user avatar
1 vote
0 answers
15 views

Software for automated data evaluation and export

We are searching for a (free/open source) software that does the following: Take raw data from file (csv and tdms, up to several 100MB uncompressed) Filter outliers (based on thresholds) Calculate ...
bobbolous's user avatar
  • 111
1 vote
0 answers
6 views

Something to collect and track data for children's meals

I work at a non-profit organization and they were paying a company that allowed them to use their program. The company is going away. The org I work with serves meals to children at different sites, ...
Luck's user avatar
  • 11
0 votes
0 answers
13 views

Tool for collecting, annotating, and analyzing social media-/text-data

I am looking for a tool that allows me to collect, annotate, and analyze social media data. I am interested in collecting data from a variety of sources, including Facebook, Twitter, and Reddit. I ...
Andy's user avatar
  • 1
0 votes
1 answer
45 views

Excel problem: protect sensible data of users and protect my formulas

I have an Excel-file with multiple sheets. The goal of the file is to provide self-employed persons a calculation beforehand of what their costs are (taxes and other cost items) based on their ...
Arie Hond's user avatar
2 votes
0 answers
15 views

Audience response software where data is stored locally

Thank you for reading. I'm looking for an audience polling/response system that can be used during a presentation in front of a live audience, allowing for audience members to vote for various options ...
Patrick's user avatar
  • 21
0 votes
1 answer
11 views

Software (web-app or iOS) to maintain and visualize data an relationships for food and dishes

I would like to maintain data sets of foods and visualize their relation to dishes. As an Avocado, I would use it in a salad or on a slice of bread. An Orange I would use to make fresh juice or in a ...
Merion's user avatar
  • 101
1 vote
0 answers
35 views

How to Repair the Corrupted Data & Make it Readable? [closed]

I Corrupted my data by taking out the SD card (which was Adopted as internal storage)multiple times without 'EJECT' / Unmount Since adopting SD card as internal storage encrypted the card to be used ...
Abhishek Rawat's user avatar
2 votes
0 answers
14 views

Data integration or ETL tool with API as destination

I am looking for a simple data integration or ETL tool to integrate data (e.g. as CSV) into our platform. There are many ETL tools (like Fivetran, Hevo, Talend, Airbyte, etc.) but they are very ...
Dennis's user avatar
  • 121
1 vote
1 answer
28 views

Tool to ensure data quality

I created an ETL in GCP, I process XML file from a bucket, and load them to bigquery. Sometimes we find that some files are not processed, or they are not in the bigquery dataset. I created a metric ...
aName's user avatar
  • 111
0 votes
1 answer
8 views

Online PIE GRAPH tool with fixed and variable inputs

I have the following problem, let's assume I have these variables: A B C D = (G + H + I) E = (L + M + N + O) F BUT WHERE N = 50% of O and L = 3% of N and A + B + C + D + E + F = TOT I would like an ...
user3450548's user avatar
1 vote
0 answers
20 views

An open source software/ecosystem I can use to quickly create faceted search UIs for CSV files in the range of 20 - 100 GBs?

Problem I have some large CSV files between 20 GB to 100 GB. The data can be useful to a lot of non technical people, each of whom will only be interested in a slice of data. I could distribute the ...
Hashir's user avatar
  • 11
2 votes
0 answers
32 views

FOSS data stack to perform complex custom logic on billions of ordered rows

Is there a purely analytics-focused (i.e. a handful of technial users, no business users or clients) FOSS data stack that would enable me to ingest several hundred million up to a billion of rows per ...
McPeanutbutter's user avatar
0 votes
0 answers
9 views

Software/Tools available for transforming SQL data and physical file names and locations

We're developing the next iteration of some software which basically collects data, stores it in SQL as a combination of columns or as JSON within columns, and stores physical files associated with ...
Jacques's user avatar
  • 101
1 vote
0 answers
22 views

Software to facilitate classification of data by human user

I'm looking for some software that makes it easy for a non-technical person to go through a spreadsheet and sort the rows into categories. The software would make it easy for people to construct rules,...
Raffi's user avatar
  • 61
1 vote
1 answer
30 views

Saving several thousand urls as html

I'm trying to download/scrape about 3000 urls and save them as HTML locally (I actually only need the contents of a certain div from each URL but the whole HTML works to). No images, js, css etc. are ...
ximivent80's user avatar
0 votes
0 answers
32 views

Java JSON/XML parser with efficient node access

I wonder if there might be a DOM-like JSON/XML parser + generator library which allows one to search the in-memory nodes (after parsing / before unparsing) by name in an efficient way (better than ...
Adrián's user avatar
  • 101
1 vote
0 answers
9 views

iPad form used to pull data from larger document

I have an 80 page PDF document with lots of tables included and I would like to create a form on an iPad where I can pull in particular tables via a check box and then submit as a new PDF (shortened ...
Alex Thorn's user avatar
1 vote
3 answers
370 views

Undelete tools for Windows with high recovery rates

I am looking for a Windows tool that tries to find & recover all deleted files on a NTFS hdd (including healthy parts of partially overwritten files). From my experience, results greatly vary. ...
summerrain's user avatar
2 votes
2 answers
266 views

Searching in .csv files on Android smartphone

I am looking for an app that allows easy search within .csv files. Minimal features can somehow read .csv files allows to search in them (searching for exact match of string in any column) is ...
reducing activity's user avatar
1 vote
0 answers
40 views

About the proper data recovery software for deleted partitions ( merged partitions after installing windows)

One of my friend and has tried to install the new windows and merged all the computer partitions and deleted important data from its hard drive, so we are trying to help him to recover its data. I ...
Soheil Paper's user avatar
0 votes
1 answer
822 views

Python library for handling and limiting bandwidth of all processes in Windows 10

I am using netlimiter, a bandwidth controlling system, in which we can limit bandwidth to a given value, kill connections and monitor realtime data usage by all processes. But It has limited trial ...
adityanithariya's user avatar
0 votes
2 answers
51 views

Data privacy on shared external HDD

I have a shared external HDD with my family and want to encrypt/secure my data. Now we already have a software that password protects the overall hard drive but once the HDD is accessed, all folders ...
Goldriver's user avatar
0 votes
0 answers
112 views

Amazon product advertising API alternative

Because my website is not online yet i could not use amazon products API in it, so I'm looking for an alternative that would let me do that. so can you recommend any good free alternative to Amazon ...
Mohcen CH's user avatar
  • 101
1 vote
1 answer
927 views

Sort a Parquet file externally by multiple columns

Problem I have a Parquet file that is much larger than my memory and would like to sort it according to two columns. Specifically let's say I have 64GB of memory, a 1TB Parquet file with the columns ...
Dahn's user avatar
  • 111
1 vote
0 answers
32 views

Need a alternative to Surveygizmo / alchemer

I have been using Surveygizmo for 5 years and it has been mostly great but in the last year. There has been several incidences of downtime without good support. The number one requirement is to be ...
kerwick's user avatar
  • 11
2 votes
1 answer
557 views

Tool for restoring firmware image from dumps taken from broken eMMC

Description of the problem: I have a 4GB eMMC chip that is "broken" which causes the device (TV) to not boot. After soldering this chip to an adapter I am able to dump it. When comparing the ...
Wi_Zeus's user avatar
  • 121
5 votes
0 answers
150 views

Android app to quickly send a text string to a Windows computer via WiFi

I'm looking for an Android app to quickly send a short (under 1K) text string from an Android device to a computer that does not have a camera. I'm looking for a simple tool with the following ...
End Antisemitic Hate's user avatar
0 votes
1 answer
37 views

Track phone data usage from PC

I manage my companies cell phones on a shared account. We allot a certain amount of data to each user each month. They are contractually obligated to this amount, else they are responsible for ...
NMALM's user avatar
  • 111
2 votes
1 answer
234 views

File comparison tool with sufficient heuristics to compare structured data like XML, HTML, JSON, and INI files

File comparison programs like WinMerge and WinMerge2011 are excellent for comparing general, non-structured data. But for comparing files that contain structured text data, like XML, HTML, and JSON, ...
End Antisemitic Hate's user avatar
0 votes
0 answers
21 views

Data Collection App Widget

I'm looking for an Android app that allows me to quickly collect data via widgets into a standard format such as sqlite or csv. The data should be stored somewhere so it can be automatically (without ...
user19087's user avatar
  • 111
1 vote
0 answers
56 views

Looking for a simple app to log photos for a beach-combing business

I'm looking for recommendations for software applications, or appropriate search keywords I should be using or other advice to identify a software solution for the following business requirement: ...
Bill's user avatar
  • 111
0 votes
1 answer
70 views

Data Mining open source tools as of 2020. Any suggestions?

I have 80,000 PDFs (whitepaper, e-books) that will be used for Marketing. I'm in dire need to look for a tool (hopefully open source) for text mining, classification, categorization of the 80,000 PDFs ...
Bowie Maris's user avatar
1 vote
2 answers
723 views

Data catalog for unstructured data for search/discovery and access provisioning (for non data engineer/science users)?

Are there any data catalogs for unstructured data (eg. loose CSV, PDF, .log, .sas, and other text files) for search/discovery and access provisioning (for non data engineer/science users)? Have seen ...
lampShadesDrifter's user avatar
0 votes
2 answers
154 views

What database can I use to store data from sensors?

I'm working on a project where experimental data is collected from a bunch of sensors. There are several ways the data is gathered and used: Some metrics are collected on regular basis. For instance, ...
Arseni Mourzenko's user avatar
1 vote
0 answers
35 views

Simple data catalog solutions for desktop

I need a simple data catalog to manage some datasets and to visualize metadata about them (descriptive statistics, variables’ description, …). Datasets are CSV files in several folders and some tables ...
bassim matar's user avatar
1 vote
0 answers
34 views

need recommendatoin for handling MDM in Big Query

I have a large warehouse that I have multiple sources come into. the pipelines are completely done, and the system is working. however, quality in business fields used in Surrogate Key definitions ...
arcee123's user avatar
  • 111
2 votes
0 answers
8 views

Is there a Windows cmd line script to add dummy labels to missing taxonomic levels in a 16S bioinformatic fasta file?

There is a common problem where taxonomic levels are are missing in 16S labels, and the convention is to fill in the missing levels with a generic place holder referencing the following lower label, ...
mizerex's user avatar
  • 21
1 vote
0 answers
11 views

Create (and make accessible) DBs to be accessed through API [closed]

We produce regularly some data sets that might be interesting for the proper audience. The DBs have some thousand enties and the entries have 15 fields in a tree form: { "item": { ...
James N.'s user avatar
1 vote
1 answer
1k views

Is there any existing software which can read the data from LCD screen via camera and put it to CSV or any other machine readable format?

For example, I have cheap 1 euro Chinese thermometer like this and I want to make a graph of the temperature depends on the time of the day. This cheap device does not have any integration with PC/...
Zlelik's user avatar
  • 111
3 votes
0 answers
45 views

Best Key-Value database for intensive insertion

We are working on a project of type (intensive insertion) should able to handle millions of insertion per day. The Current situation we have two table one of them includes 2 billion record (Id & ...
Tarek's user avatar
  • 31
0 votes
1 answer
67 views

Open-source software with API to manage very dynamic data tables

I'd know if there's any open-source software with API aimed to handle a (virtually) infinite number of tables of semi-structured data. What I already know Relational databases We all know that the ...
Xavi Montero's user avatar
0 votes
1 answer
41 views

Open and visually browse large CSV files [closed]

Which software do you recommend to open and visually browse large (>2.5 GB) CSV files?
Stücke's user avatar
  • 131
1 vote
0 answers
24 views

Data entity definition language

I'm aware that most languages allow you to define data entities and the relationships between then in various ways; but I'm wondering if there's anything that's targeted specifically at holding this ...
JohnLBevan's user avatar