Questions tagged [data]
The data tag has no usage guidance.
145
questions
0
votes
0
answers
4
views
What tool or third party to use to download a large number of files with proxy to cloud storage
So I have urls of a lot of pdf files from various websites. Like 700k of them. I want to download them to my Google Cloud Bucket.
I am getting ip banned from some sites. Thus I was wondering there ...
- 101
1
vote
0
answers
6
views
Software for semantic layer in the field of business intelligence
I am currently looking for a business-layer-software or semantic-layer-software to replace SAP business objects. I am working for a data-management team for the public sector.
Do you have any ...
- 11
1
vote
2
answers
122
views
Recovering an important Excel file after formatting disk
A friend of mine has just deleted partitions on his main disk through the Windows 10 installer, and has reinstalled Windows 10 on his now clean 256GB Samsung SSD.
He backed up most of his files, ...
- 119
1
vote
0
answers
15
views
Software for automated data evaluation and export
We are searching for a (free/open source) software that does the following:
Take raw data from file (csv and tdms, up to several 100MB
uncompressed)
Filter outliers (based on thresholds)
Calculate
...
- 111
1
vote
0
answers
6
views
Something to collect and track data for children's meals
I work at a non-profit organization and they were paying a company that allowed them to use their program. The company is going away. The org I work with serves meals to children at different sites, ...
- 11
0
votes
0
answers
13
views
Tool for collecting, annotating, and analyzing social media-/text-data
I am looking for a tool that allows me to collect, annotate, and analyze social media data. I am interested in collecting data from a variety of sources, including Facebook, Twitter, and Reddit. I ...
- 1
0
votes
1
answer
44
views
Excel problem: protect sensible data of users and protect my formulas
I have an Excel-file with multiple sheets. The goal of the file is to provide self-employed persons a calculation beforehand of what their costs are (taxes and other cost items) based on their ...
2
votes
0
answers
14
views
Audience response software where data is stored locally
Thank you for reading.
I'm looking for an audience polling/response system that can be used during a presentation in front of a live audience, allowing for audience members to vote for various options ...
- 21
0
votes
1
answer
11
views
Software (web-app or iOS) to maintain and visualize data an relationships for food and dishes
I would like to maintain data sets of foods and visualize their relation to dishes.
As an Avocado, I would use it in a salad or on a slice of bread.
An Orange I would use to make fresh juice or in a ...
- 101
0
votes
0
answers
9
views
software for generating information from artificial/designed worlds with agents
Please recommend software for retrieving information about a world modeled with various parameters such as a number of agents, agent movements, time etc.
I seek feedback from folks experienced with ...
- 101
0
votes
0
answers
8
views
Is there any platform that specifically ranks, estimates or quantifies app bugginess / performance?
I have experienced that an app has a very good average ranking on the App Store but then it can be very buggy and if you google it you see tons of people agreeing it’s unusably slow or freezes (such ...
- 171
1
vote
0
answers
35
views
How to Repair the Corrupted Data & Make it Readable? [closed]
I Corrupted my data by taking out the
SD card (which was Adopted as internal storage)multiple times
without
'EJECT'
/ Unmount
Since adopting SD card as internal storage encrypted the card to be used ...
2
votes
0
answers
11
views
Data integration or ETL tool with API as destination
I am looking for a simple data integration or ETL tool to integrate data (e.g. as CSV) into our platform. There are many ETL tools (like Fivetran, Hevo, Talend, Airbyte, etc.) but they are very ...
- 121
1
vote
1
answer
27
views
Tool to ensure data quality
I created an ETL in GCP, I process XML file from a bucket, and load them to bigquery.
Sometimes we find that some files are not processed, or they are not in the bigquery dataset.
I created a metric ...
- 111
0
votes
1
answer
8
views
Online PIE GRAPH tool with fixed and variable inputs
I have the following problem, let's assume I have these variables:
A
B
C
D = (G + H + I)
E = (L + M + N + O)
F
BUT WHERE N = 50% of O and L = 3% of N
and A + B + C + D + E + F = TOT
I would like an ...
- 638
1
vote
0
answers
20
views
An open source software/ecosystem I can use to quickly create faceted search UIs for CSV files in the range of 20 - 100 GBs?
Problem
I have some large CSV files between 20 GB to 100 GB. The data can be useful to a lot of non technical people, each of whom will only be interested in a slice of data. I could distribute the ...
- 11
2
votes
0
answers
29
views
FOSS data stack to perform complex custom logic on billions of ordered rows
Is there a purely analytics-focused (i.e. a handful of technial users, no business users or clients) FOSS data stack that would enable me to
ingest several hundred million up to a billion of rows per ...
0
votes
0
answers
9
views
Software/Tools available for transforming SQL data and physical file names and locations
We're developing the next iteration of some software which basically collects data, stores it in SQL as a combination of columns or as JSON within columns, and stores physical files associated with ...
- 101
1
vote
0
answers
22
views
Software to facilitate classification of data by human user
I'm looking for some software that makes it easy for a non-technical person to go through a spreadsheet and sort the rows into categories. The software would make it easy for people to construct rules,...
- 61
1
vote
1
answer
29
views
Saving several thousand urls as html
I'm trying to download/scrape about 3000 urls and save them as HTML locally (I actually only need the contents of a certain div from each URL but the whole HTML works to). No images, js, css etc. are ...
- 11
0
votes
0
answers
31
views
Java JSON/XML parser with efficient node access
I wonder if there might be a DOM-like JSON/XML parser + generator library which allows one to search the in-memory nodes (after parsing / before unparsing) by name in an efficient way (better than ...
- 101
1
vote
0
answers
9
views
iPad form used to pull data from larger document
I have an 80 page PDF document with lots of tables included and I would like to create a form on an iPad where I can pull in particular tables via a check box and then submit as a new PDF (shortened ...
- 11
1
vote
3
answers
329
views
Undelete tools for Windows with high recovery rates
I am looking for a Windows tool that tries to find & recover all deleted files on a NTFS hdd (including healthy parts of partially overwritten files).
From my experience, results greatly vary.
...
- 163
2
votes
2
answers
220
views
Searching in .csv files on Android smartphone
I am looking for an app that allows easy search within .csv files.
Minimal features
can somehow read .csv files
allows to search in them (searching for exact match of string in any column) is ...
- 1,112
1
vote
0
answers
39
views
About the proper data recovery software for deleted partitions ( merged partitions after installing windows)
One of my friend and has tried to install the new windows and merged all the computer partitions and deleted important data from its hard drive, so we are trying to help him to recover its data.
I ...
- 161
0
votes
1
answer
686
views
Python library for handling and limiting bandwidth of all processes in Windows 10
I am using netlimiter, a bandwidth controlling system, in which we can limit bandwidth to a given value, kill connections and monitor realtime data usage by all processes.
But It has limited trial ...
0
votes
2
answers
51
views
Data privacy on shared external HDD
I have a shared external HDD with my family and want to encrypt/secure my data. Now we already have a software that password protects the overall hard drive but once the HDD is accessed, all folders ...
0
votes
0
answers
100
views
Amazon product advertising API alternative
Because my website is not online yet i could not use amazon products API in it, so I'm looking for an alternative that would let me do that.
so can you recommend any good free alternative to Amazon ...
- 101
0
votes
1
answer
689
views
Sort a Parquet file externally by multiple columns
Problem
I have a Parquet file that is much larger than my memory and would like to sort it according to two columns.
Specifically let's say I have 64GB of memory, a 1TB Parquet file with the columns ...
- 101
1
vote
0
answers
26
views
Need a alternative to Surveygizmo / alchemer
I have been using Surveygizmo for 5 years and it has been mostly great but in the last year. There has been several incidences of downtime without good support. The number one requirement is to be ...
- 11
2
votes
1
answer
434
views
Tool for restoring firmware image from dumps taken from broken eMMC
Description of the problem:
I have a 4GB eMMC chip that is "broken" which causes the device (TV) to not boot.
After soldering this chip to an adapter I am able to dump it.
When comparing the ...
- 121
5
votes
0
answers
144
views
Android app to quickly send a text string to a Windows computer via WiFi
I'm looking for an Android app to quickly send a short (under 1K) text string from an Android device to a computer that does not have a camera.
I'm looking for a simple tool with the following ...
- 6,716
0
votes
1
answer
36
views
Track phone data usage from PC
I manage my companies cell phones on a shared account. We allot a certain amount of data to each user each month. They are contractually obligated to this amount, else they are responsible for ...
- 111
2
votes
1
answer
189
views
File comparison tool with sufficient heuristics to compare structured data like XML, HTML, JSON, and INI files
File comparison programs like WinMerge and WinMerge2011 are excellent for comparing general, non-structured data.
But for comparing files that contain structured text data, like XML, HTML, and JSON, ...
- 6,716
0
votes
0
answers
21
views
Data Collection App Widget
I'm looking for an Android app that allows me to quickly collect data via widgets into a standard format such as sqlite or csv. The data should be stored somewhere so it can be automatically (without ...
- 111
1
vote
0
answers
52
views
Looking for a simple app to log photos for a beach-combing business
I'm looking for recommendations for software applications, or appropriate search keywords I should be using or other advice to identify a software solution for the following business requirement:
...
- 111
0
votes
1
answer
64
views
Data Mining open source tools as of 2020. Any suggestions?
I have 80,000 PDFs (whitepaper, e-books) that will be used for Marketing. I'm in dire need to look for a tool (hopefully open source) for text mining, classification, categorization of the 80,000 PDFs ...
- 41
1
vote
2
answers
598
views
Data catalog for unstructured data for search/discovery and access provisioning (for non data engineer/science users)?
Are there any data catalogs for unstructured data (eg. loose CSV, PDF, .log, .sas, and other text files) for search/discovery and access provisioning (for non data engineer/science users)?
Have seen ...
0
votes
2
answers
115
views
What database can I use to store data from sensors?
I'm working on a project where experimental data is collected from a bunch of sensors. There are several ways the data is gathered and used:
Some metrics are collected on regular basis. For instance, ...
- 273
1
vote
0
answers
33
views
Simple data catalog solutions for desktop
I need a simple data catalog to manage some datasets and to visualize metadata about them (descriptive statistics, variables’ description, …). Datasets are CSV files in several folders and some tables ...
- 11
1
vote
0
answers
31
views
need recommendatoin for handling MDM in Big Query
I have a large warehouse that I have multiple sources come into. the pipelines are completely done, and the system is working.
however, quality in business fields used in Surrogate Key definitions ...
- 111
2
votes
0
answers
8
views
Is there a Windows cmd line script to add dummy labels to missing taxonomic levels in a 16S bioinformatic fasta file?
There is a common problem where taxonomic levels are are missing in 16S labels, and the convention is to fill in the missing levels with a generic place holder referencing the following lower label, ...
- 21
1
vote
0
answers
11
views
Create (and make accessible) DBs to be accessed through API [closed]
We produce regularly some data sets that might be interesting for the proper audience.
The DBs have some thousand enties and the entries have 15 fields in a tree form:
{
"item": {
...
- 11
1
vote
1
answer
828
views
Is there any existing software which can read the data from LCD screen via camera and put it to CSV or any other machine readable format?
For example, I have cheap 1 euro Chinese thermometer like this
and I want to make a graph of the temperature depends on the time of the day. This cheap device does not have any integration with PC/...
- 111
3
votes
0
answers
43
views
Best Key-Value database for intensive insertion
We are working on a project of type (intensive insertion) should able to handle millions of insertion per day.
The Current situation
we have two table one of them includes 2 billion record (Id & ...
- 31
0
votes
1
answer
61
views
Open-source software with API to manage very dynamic data tables
I'd know if there's any open-source software with API aimed to handle a (virtually) infinite number of tables of semi-structured data.
What I already know
Relational databases
We all know that the ...
- 111
0
votes
1
answer
40
views
Open and visually browse large CSV files [closed]
Which software do you recommend to open and visually browse large (>2.5 GB) CSV files?
- 131
1
vote
0
answers
24
views
Data entity definition language
I'm aware that most languages allow you to define data entities and the relationships between then in various ways; but I'm wondering if there's anything that's targeted specifically at holding this ...
- 243
1
vote
0
answers
22
views
Software for categorizing data based on language and type
Currently, I'm using windows file explorer for categorizing. There are folders for years (2017, 2018, etc.) and each of them has sub-folders for types (type_1, type_2, etc.) and under each sub-folder, ...
- 11
1
vote
1
answer
22
views
Best software for visualising data in a 3D space [closed]
I need to show a collection of data and would like to do this in a 3D space which could be interacted with by viewers.
Can either be cloud based or local software.
