Questions tagged [data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
11 views

Open-source software with API to manage very dynamic data tables

I'd know if there's any open-source software with API aimed to handle a (virtually) infinite number of tables of semi-structured data. What I already know Relational databases We all know that the ...
0
votes
1answer
23 views

Open and visually browse large CSV files [closed]

Which software do you recommend to open and visually browse large (>2.5 GB) CSV files?
0
votes
0answers
6 views

Looking for Open Source OPC UA Web Server

I am looking to log tags from PLC into a database. I have software called 'ogamma logger' that will be used to connect to the OPC UA server. Ogamma logger will log data to postgreSQL database. I am ...
0
votes
0answers
6 views

What web service can store JSON data, what I can query from my webpage with JavaScript?

I would like to use some web data storage service, where I can register, and then I will be able to store small amount of textual data, namely JSON. It would be important, that the data can be updated ...
1
vote
0answers
9 views

Data entity definition language

I'm aware that most languages allow you to define data entities and the relationships between then in various ways; but I'm wondering if there's anything that's targeted specifically at holding this ...
1
vote
0answers
19 views

Software for categorizing data based on language and type

Currently, I'm using windows file explorer for categorizing. There are folders for years (2017, 2018, etc.) and each of them has sub-folders for types (type_1, type_2, etc.) and under each sub-folder, ...
1
vote
1answer
15 views

Best software for visualising data in a 3D space [closed]

I need to show a collection of data and would like to do this in a 3D space which could be interacted with by viewers. Can either be cloud based or local software.
0
votes
1answer
11 views

create a formatted data file filled with random values

I need to find a tool that i can use to create a large file of up to 5000 lines (or more). Each line must be formatted like such [30 Random Characters], [0-150] [Single Char (S,M,L)] [0-9][0-9]:[0-...
0
votes
0answers
6 views

Containerized Big Data Solution - Apache Hudi - Where to Start

Looking for a stable docker container that has Apache {Hadoop, Hive, Kafka, Spark, Zookeeper} installed and configured. Saw that Apache Hudi had a similar solution however it is in the incubation ...
0
votes
0answers
8 views

A GitLab/Kaggle for open data management?

We know, for code there is GitHub and GitLab. GitLab's major difference is that this platform is available as open source software you could run yourself. I've seen questions like "what is GitHub for ...
3
votes
2answers
108 views

Looking for an app to track all foods eaten and how I felt

I am looking for an app (It should work on Android and ideally on Windows or browsers) to be able to precisely track all foods eaten. I am not interested in anything too complex, and I do not want ...
0
votes
1answer
22 views

Is there a software, making questions with given data as answer to it?

Is there a software, making questions with given data as answer to it? I have a math project; I am writing a review of the "search of solution set of quintic equations". I have taken primary sources ...
1
vote
0answers
39 views

Recommendations For examining XML

Are there any tools out there that are used to view and examine through large XML files? I work for a small company as a Data Quality Analyst and a lot of my job is looking through large XML files ...
1
vote
0answers
23 views

Flash Card App that allows data tree linking between cards?

I'm currently studying Japanese Kanji: I've taken a large list of kanji (2300) and arranged them all into smaller groups with about 4 kanji on average per group, based on their similar looks etc. (...
1
vote
0answers
16 views

Gratis data file viewer with search for Windows (to view and search for text in any file)

When I encounter a file of unknown contents, I often open it up in a hex editor or text editor to look inside. The problem with a hex editor is that I'm usually much more interested in content that I ...
2
votes
3answers
87 views

What's an alternative to spreadsheets that has cells with defined type of value?

I don't like spreadsheets because they are not typed, any cell can have a value of any type. That can cause errors. I'd like to be able to define a type for any cell and the software would prevent the ...
0
votes
1answer
39 views

Is there any API which can provide information on different animal species?

I am working on a project (not a programming project) where we require a lot of information about different species such as average weight, lifespan, height, population numbers, endangered status etc. ...
0
votes
0answers
34 views

What is the best web scraping tool with a user interface / GUI?

I work for a small social entrepreneurship start-up that is compiling a large database of gender and international development data. We're looking for a web scraping tool (Mac compatible) with a user ...
1
vote
0answers
46 views

Splitting a KML file by year / location

I have a large KML file containing enough data to cause most programs including Google Earth to have problems. I would like to divide it by year. However, if it could detect when I left my home city,...
0
votes
0answers
11 views

Client Management System with user-friendly interface

Do you know of some self-hosted Client Management System to manage our clients data, so we can do things like searches, filters, reordering, grouping clients by criteria, etc? The most important ...
0
votes
0answers
8 views

How to create basic analytics for each user? Open-source options?

I have been looking into how to create custom analytics for each user of a music site. So the user portfolio will show some analytics such as: Sales Plays (total and for individual tracks) Profile ...
1
vote
0answers
19 views

Recover deleted data [closed]

I've been searching for free or paid data recovery software that is flexible enough to recover only specified folders/subfolders/files deleted after a specified date. Does anyone have recommendations?
1
vote
0answers
11 views

Recommendations for Technology Stacks Needed to Build a Feature Store?

I am in the process of designing a simple but robust and scalable feature store architecture. So far, I've built a framework for creating custom feature pipelines in Scikit-Learn. Ideally, I want the ...
0
votes
0answers
7 views

Serverless python requests with long timeouts?

I have a several python scripts that follow a similar format: you pass in a date, and it either: - checks my S3 bucket for the file with that date in the filename, and parses it or - Runs a python ...
3
votes
0answers
35 views

Schema Mapping Tool

I have several flat file data sources (CSVs) that are extracted, transformed and loaded into relational tables. At some point in time, when I look at a table, I often have a hard time figuring out ...
0
votes
1answer
24 views

Software to clean unnecessary memory from my PC without making any kind of damage?

I do have a lot of unnecessary data in my C-drive, some of them are from previously installed software and some are just some temporary files... Can you suggest me some good software to clean them ...
0
votes
0answers
9 views

Data cataloger for local file system and relational DBs

Currently have a situation where we have an amount of data that does not justify using Hadoop and HDFS, but would still like a local data cataloging solution like Apache Atlas for data cataloging and ...
0
votes
0answers
5 views

MNIST dataset Conversion

I've trained a decision tree on a dataset (handwritten) which contains 8 x-y points sampled along the length of the number (number digit dataset). The test dataset given (assignment), is the MNIST ...
0
votes
0answers
6 views

What tool can I use to dynamically add entries?

My boss asked me to use Survey Monkey to gather data from severl branches of our company , but he wants it to ask for the opening times of each point of sale of each branch. That would be, input one ...
0
votes
0answers
7 views

Any tools that can get a review of the webpage layout

so I have this huge list of domains which I need to check what the website content is about, to get a general overview: for e.g. bbc.com is a news site. Any software tools that can do this, please ...
0
votes
0answers
7 views

How can I create an interactive metro map?

I have some data about the Toronto Metrolinx system. What I'm trying to create is an interactive version of the infographic below: https://metrolinx.files.wordpress.com/2019/01/click-right-here-for-...
0
votes
0answers
26 views

Organising information in a censorship-resistant way - personal wiki on the blockchain?

Background to this question: Terrorist Act in the UK: https://genesis.re/wiki#Terrorism_Act Can Police force me to unlock my phone: https://twitter.com/marsxrobertson/status/1170132167122391041 ...
0
votes
0answers
8 views

A solution to automate adding customized data sets (rows) to a main big workbook

Our company uses SAP Business Warehouse to consolidate data from many sources and I access that data under Excel files. Now we try to find a solution to save daily new data to a main large file (also ...
0
votes
0answers
9 views

What recommendations do you have for AI to manage data in my company?

We have a bit of an issue with the quality of our data in my company where the data in a process passes through many systems. We have looked at and are using BluePrism for automating tedious manual ...
1
vote
0answers
7 views

Great scraping tools/ data mining tools for bulk of websites, extracting few emails from each?

I have been looking for good open source tools / softwares that can read certain patterns and scrape a bulk of provided websites... My use case is like this: I have a list of ~900 company websites ...
0
votes
0answers
20 views

I am looking for PDFs testing automation software

PDF Testing Compare data from flat files to PDFs Write logic to ensure PDF has correct data Ensure there must be correct logos, bar codes, fonts, margin etc. Please give me some recommendations
0
votes
0answers
3 views

Tools for moving data inside a redshift instance

I have two areas in my redshift instance - staging and production. Once the data is dumped into the staging area, it needs to be cleansed and transformed before moving it into production. What tools ...
1
vote
1answer
23 views

Looking for alternative to email for sending automated weather alerts

We have a website that monitors weather conditions. A cron job runs frequently, which generates alerts if it's too windy/hot/whatever. We already have all this running with alerts being sent by email, ...
0
votes
0answers
6 views

Software to help speed up backend data processing

I am building a web app using R (Shiny framework). On the server side, I am reading data from a SQLite database into multiple dataframes and performing various operations on those dataframes (eg ...
0
votes
0answers
11 views

How to find complex correlations between several variables?

I am looking for a tool or Python library, to analyse data and (automatically) find correlations between several variables (more than 2, numerical or not). These are the kind of things I would like ...
0
votes
0answers
6 views

Encrypted data and DLP

I was looking at solutions to detect sensitive data using a DLP solution, from a encrypted data set being transmitted. Although DLP can detect and block password protected files, I don't suppose it ...
0
votes
0answers
5 views

SQL Query MAC OS - Visual data

Im looking for the right software, or any software to help visualise some SQL queries. I have a downloaded database that I would like to run some queries on with the ability to show this data as a ...
0
votes
0answers
9 views

Mapping Customers DB to my to my databse

I'm trying to connect to various customers and map their databases to my database. I need a tool that I can comfortably map their database column/keys to my keys. currently, I'm writing big mapping ...
0
votes
0answers
4 views

Help me find a software to add addresses to a list with names, cities, states, and zipcodes?

I need a software in which I can upload a person's first name, last name, city, state, and zip-code, and have the software automatically add the person's address. I have found services that can ...
0
votes
0answers
3 views

What software I should use to store data on server for mobile games?

Here is a newbie for mobile game development. I want to know what is popularly used to store game data nowadays? DataBase, key-value store or something else? In my case, I need to store shared data ...
0
votes
0answers
16 views

Software to show Tabular Data in Angular based front end application

I am looking for recommendation(both licensed and open source) for a 1. Tool/software to show large tabular data in my Angular application, 2. Showing the bar chart against each filter option. I ...
1
vote
0answers
4 views

Analyze Websites for Key Words

I'd like to analyze Github and other websites for the prevelancy of certain key words. How would I go about doing this? The solution must be able to complete the following: Check for the occurrence ...
0
votes
0answers
9 views

entity - relationship builder software

i'm looking for some kind of software that would let me create "entities" (people, places, things, etc) with different characteristics (to be set by me) and tags. Then the software should be able to ...
1
vote
1answer
34 views

Prepare dataset in CSV for machine learning?

I have a dataset consisting of CSV files (weather data). My issue is to clean the wrong values or empty values before using the dataset for machine learning. Right now I have to copy by hand the data ...
1
vote
0answers
5 views

NodeJS package to generate correlated data?

I am looking to create a synthetic database and for that I need to generate some ordinal data that has a correlation, say 0.5. I have seen packages in R to generate correlated ordinal data based on ...