Questions tagged [data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
13 views

Saving several thousand urls as html

Im trying to download/scrape about 3000 urls and save them as html locally (I actually only need the contents of a certain div from each url but the whole html works to). No images,js,css etc. is ...
user avatar
0 votes
0 answers
13 views

Java JSON/XML parser with efficient node access

I wonder if there might be a DOM-like JSON/XML parser + generator library which allows one to search the in-memory nodes (after parsing / before unparsing) by name in an efficient way (better than ...
user avatar
0 votes
0 answers
11 views

Online Software (PHP?) To display parsed JSON/CSV API data?

I have JSON data from several API calls. Let's call these: Store 1 Store 2 Store 3 Lets say each store has three headers: Name of Product, Daily Sales, Total Sales. Is there any source code to display ...
user avatar
1 vote
0 answers
9 views

iPad form used to pull data from larger document

I have an 80 page PDF document with lots of tables included and I would like to create a form on an iPad where I can pull in particular tables via a check box and then submit as a new PDF (shortened ...
user avatar
1 vote
2 answers
230 views

Undelete tools for Windows with high recovery rates

I am looking for a Windows tool that tries to find & recover all deleted files on a NTFS hdd (including healthy parts of partially overwritten files). From my experience, results greatly vary. ...
user avatar
2 votes
1 answer
56 views

Searching in .csv files on Android smartphone

I am looking for an app that allows easy search within .csv files. Minimal features can somehow read .csv files allows to search in them (searching for exact match of string in any column) is ...
user avatar
0 votes
0 answers
8 views

Plan which files/directories to put on which drive (bin packing problem)

I want to plan which files/directories to put on which drive. (Not all fit on one drive.) This is similar to the bin packing problem. The difference is that I care about meaningful grouping, so I want ...
user avatar
  • 151
0 votes
0 answers
7 views

JavaScript browser library for pivot, reshape, and aggregate data

I'm looking for a javascript library which can run in the browser and perform pivot/reshape/aggregation operations. For instance let's I have data like: [ { category: "Toy", sub: &...
user avatar
  • 151
0 votes
0 answers
9 views

Any Distributed Web crawling software out there?

I would like to do some web mining. The ideal crawling tools could be Spark and Scrapy but I can adapt. I found this interesting question on StackOverflow and in the comments there are already a few ...
user avatar
0 votes
0 answers
12 views

Data traceability in C++

We have a system which communicates over BSD sockets. A message comes in, the data are unpacked in to local variables/structures, then are passed as input into functions, maybe manipulated & ...
user avatar
0 votes
0 answers
8 views

Visualization of data migration strategy

A legacy system is already running for years and a new version is being build from ground up. At the MVP milestone, customers will start to be migrated from the legacy system to the new system. For ...
user avatar
1 vote
0 answers
33 views

About the proper data recovery software for deleted partitions ( merged partitions after installing windows)

One of my friend and has tried to install the new windows and merged all the computer partitions and deleted important data from its hard drive, so we are trying to help him to recover its data. I ...
user avatar
0 votes
0 answers
7 views

Open source High Definition maps Software Recommendations

I donot seem to find a good open source software that I can use for High definition maps testing that can read raster, vector, sensor data. Is there any potential open source softwares or APIs for HD ...
user avatar
  • 1
0 votes
1 answer
128 views

Python library for handling and limiting bandwidth of all processes in Windows 10

I am using netlimiter, a bandwidth controlling system, in which we can limit bandwidth to a given value, kill connections and monitor realtime data usage by all processes. But It has limited trial ...
user avatar
0 votes
2 answers
48 views

Data privacy on shared external HDD

I have a shared external HDD with my family and want to encrypt/secure my data. Now we already have a software that password protects the overall hard drive but once the HDD is accessed, all folders ...
user avatar
0 votes
0 answers
26 views

Amazon product advertising API alternative

Because my website is not online yet i could not use amazon products API in it, so I'm looking for an alternative that would let me do that. so can you recommend any good free alternative to Amazon ...
user avatar
  • 101
0 votes
0 answers
12 views

Requirements documentation for data, documents and processes

I am looking to document data requirements that result from existing and newly defined document sources and outputs, as well as processes (e.g., we get an asking price from document A, we list all ...
user avatar
  • 101
0 votes
1 answer
194 views

Sort a Parquet file externally by multiple columns

Problem I have a Parquet file that is much larger than my memory and would like to sort it according to two columns. Specifically let's say I have 64GB of memory, a 1TB Parquet file with the columns ...
user avatar
  • 101
1 vote
0 answers
23 views

Need a alternative to Surveygizmo / alchemer

I have been using Surveygizmo for 5 years and it has been mostly great but in the last year. There has been several incidences of downtime without good support. The number one requirement is to be ...
user avatar
  • 11
0 votes
0 answers
15 views

How to get the most frequently searched terms for people of a particular profession?

Suppose you want to know what radiologists usually search for online. Is there a service that can sell you this data? I have no experience with SEO, but I suppose that only the company that operates a ...
user avatar
2 votes
1 answer
100 views

Tool for restoring firmware image from dumps taken from broken eMMC

Description of the problem: I have a 4GB eMMC chip that is "broken" which causes the device (TV) to not boot. After soldering this chip to an adapter I am able to dump it. When comparing the ...
user avatar
  • 121
4 votes
0 answers
85 views

Android app to quickly send a text string to a Windows computer via WiFi

I'm looking for an Android app to quickly send a short (under 1K) text string from an Android device to a computer that does not have a camera. I'm looking for a simple tool with the following ...
user avatar
0 votes
1 answer
23 views

Track phone data usage from PC

I manage my companies cell phones on a shared account. We allot a certain amount of data to each user each month. They are contractually obligated to this amount, else they are responsible for ...
user avatar
  • 111
1 vote
1 answer
71 views

File comparison tool with sufficient heuristics to compare structured data like XML, HTML, JSON, and INI files

File comparison programs like WinMerge and WinMerge2011 are excellent for comparing general, non-structured data. But for comparing files that contain structured text data, like XML, HTML, and JSON, ...
user avatar
0 votes
0 answers
20 views

Data Collection App Widget

I'm looking for an Android app that allows me to quickly collect data via widgets into a standard format such as sqlite or csv. The data should be stored somewhere so it can be automatically (without ...
user avatar
  • 111
1 vote
0 answers
44 views

Looking for a simple app to log photos for a beach-combing business

I'm looking for recommendations for software applications, or appropriate search keywords I should be using or other advice to identify a software solution for the following business requirement: ...
user avatar
  • 111
0 votes
1 answer
59 views

Data Mining open source tools as of 2020. Any suggestions?

I have 80,000 PDFs (whitepaper, e-books) that will be used for Marketing. I'm in dire need to look for a tool (hopefully open source) for text mining, classification, categorization of the 80,000 PDFs ...
user avatar
1 vote
2 answers
196 views

Data catalog for unstructured data for search/discovery and access provisioning (for non data engineer/science users)?

Are there any data catalogs for unstructured data (eg. loose CSV, PDF, .log, .sas, and other text files) for search/discovery and access provisioning (for non data engineer/science users)? Have seen ...
user avatar
0 votes
2 answers
32 views

What database can I use to store data from sensors?

I'm working on a project where experimental data is collected from a bunch of sensors. There are several ways the data is gathered and used: Some metrics are collected on regular basis. For instance, ...
user avatar
1 vote
0 answers
30 views

Simple data catalog solutions for desktop

I need a simple data catalog to manage some datasets and to visualize metadata about them (descriptive statistics, variables’ description, …). Datasets are CSV files in several folders and some tables ...
user avatar
1 vote
0 answers
16 views

need recommendatoin for handling MDM in Big Query

I have a large warehouse that I have multiple sources come into. the pipelines are completely done, and the system is working. however, quality in business fields used in Surrogate Key definitions ...
user avatar
  • 111
2 votes
0 answers
7 views

Is there a Windows cmd line script to add dummy labels to missing taxonomic levels in a 16S bioinformatic fasta file?

There is a common problem where taxonomic levels are are missing in 16S labels, and the convention is to fill in the missing levels with a generic place holder referencing the following lower label, ...
user avatar
  • 21
1 vote
0 answers
10 views

Create (and make accessible) DBs to be accessed through API [closed]

We produce regularly some data sets that might be interesting for the proper audience. The DBs have some thousand enties and the entries have 15 fields in a tree form: { "item": { ...
user avatar
0 votes
1 answer
131 views

Is there any existing software which can read the data from LCD screen via camera and put it to CSV or any other machine readable format?

For example, I have cheap 1 euro Chinese thermometer like this and I want to make a graph of the temperature depends on the time of the day. This cheap device does not have any integration with PC/...
user avatar
  • 101
3 votes
0 answers
36 views

Best Key-Value database for intensive insertion

We are working on a project of type (intensive insertion) should able to handle millions of insertion per day. The Current situation we have two table one of them includes 2 billion record (Id & ...
user avatar
  • 31
0 votes
1 answer
45 views

Open-source software with API to manage very dynamic data tables

I'd know if there's any open-source software with API aimed to handle a (virtually) infinite number of tables of semi-structured data. What I already know Relational databases We all know that the ...
user avatar
0 votes
1 answer
33 views

Open and visually browse large CSV files [closed]

Which software do you recommend to open and visually browse large (>2.5 GB) CSV files?
user avatar
  • 131
1 vote
0 answers
22 views

Data entity definition language

I'm aware that most languages allow you to define data entities and the relationships between then in various ways; but I'm wondering if there's anything that's targeted specifically at holding this ...
user avatar
1 vote
0 answers
21 views

Software for categorizing data based on language and type

Currently, I'm using windows file explorer for categorizing. There are folders for years (2017, 2018, etc.) and each of them has sub-folders for types (type_1, type_2, etc.) and under each sub-folder, ...
user avatar
  • 11
1 vote
1 answer
20 views

Best software for visualising data in a 3D space [closed]

I need to show a collection of data and would like to do this in a 3D space which could be interacted with by viewers. Can either be cloud based or local software.
user avatar
0 votes
1 answer
27 views

create a formatted data file filled with random values

I need to find a tool that i can use to create a large file of up to 5000 lines (or more). Each line must be formatted like such [30 Random Characters], [0-150] [Single Char (S,M,L)] [0-9][0-9]:[0-...
user avatar
3 votes
2 answers
122 views

Looking for an app to track all foods eaten and how I felt

I am looking for an app (It should work on Android and ideally on Windows or browsers) to be able to precisely track all foods eaten. I am not interested in anything too complex, and I do not want ...
user avatar
0 votes
1 answer
25 views

Is there a software, making questions with given data as answer to it?

Is there a software, making questions with given data as answer to it? I have a math project; I am writing a review of the "search of solution set of quintic equations". I have taken primary sources ...
user avatar
  • 121
1 vote
0 answers
49 views

Recommendations For examining XML

Are there any tools out there that are used to view and examine through large XML files? I work for a small company as a Data Quality Analyst and a lot of my job is looking through large XML files ...
user avatar
1 vote
0 answers
30 views

Flash Card App that allows data tree linking between cards?

I'm currently studying Japanese Kanji: I've taken a large list of kanji (2300) and arranged them all into smaller groups with about 4 kanji on average per group, based on their similar looks etc. (...
user avatar
  • 11
2 votes
0 answers
21 views

Gratis data file viewer with search for Windows (to view and search for text in any file)

When I encounter a file of unknown contents, I often open it up in a hex editor or text editor to look inside. The problem with a hex editor is that I'm usually much more interested in content that I ...
user avatar
2 votes
3 answers
101 views

What's an alternative to spreadsheets that has cells with defined type of value?

I don't like spreadsheets because they are not typed, any cell can have a value of any type. That can cause errors. I'd like to be able to define a type for any cell and the software would prevent the ...
user avatar
  • 31
0 votes
1 answer
56 views

Is there any API which can provide information on different animal species?

I am working on a project (not a programming project) where we require a lot of information about different species such as average weight, lifespan, height, population numbers, endangered status etc. ...
user avatar
  • 103
1 vote
0 answers
54 views

Splitting a KML file by year / location

I have a large KML file containing enough data to cause most programs including Google Earth to have problems. I would like to divide it by year. However, if it could detect when I left my home city,...
user avatar
  • 1,621
0 votes
0 answers
15 views

Client Management System with user-friendly interface

Do you know of some self-hosted Client Management System to manage our clients data, so we can do things like searches, filters, reordering, grouping clients by criteria, etc? The most important ...
user avatar
  • 161