Questions tagged [data-analysis]

Data Analysis tools enable you to take a set of data and extract abstract information out of them.

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

Recommendations for an ELT tool for Workflow Automation

i get raw data quarterly. Essentially they are dumps from relational database tables. I import them into mysql bounce them against a reference database to get some validated columns then export the ...
0
votes
0answers
4 views

What can be a good tool for reporting the data from DynamoDB

I have a around 4 tables in dynamodb, each not more than 500 mbs of data but might have rows in Billions. Now I am looking for a tool which can take my dynamoDB data as a data source and then in that ...
-1
votes
0answers
7 views

Python data cleaning for CSV using Pandas and PySpark and mapping to JSON in AWS ETL Glue Environment [on hold]

I have recently started working on some ETL work and wanted some guidance in this area related to data cleaning from CSV to JSON mapping using AWS Glue, Python (pandas, pyspark). Question Need a ...
0
votes
0answers
6 views

Prediction framework for financial data, to develop financial model

My goal is to create a model that can predict the impact of major macroeconomic shocks (ex. Policy changes, trade war…). Like many other models, I am trying to reduce the uncertainty/risk factor as ...
0
votes
0answers
3 views

Analyse massive volume of websites quickly. Cluster Computing? Cloud?

I have a rather large list of domain names, and a rather large set of checks and audits that I have developed to review them all. I intend to attempt to train a machine learning model to make ...
0
votes
0answers
3 views

ADLS Gen1 to Gen2 migration using Azure Data Factory - Copy Data Activity [closed]

How can we estimate the time taken for: ADLS Gen1 to Gen2 migration using Azure Data Factory - Copy Data Activity for 80TB Data. What are the best practices other than using Azure Data Factory to ...
0
votes
0answers
2 views

Tool to find duplicate repeated groups of lines in log files?

I want to use it to reduce (either graphically collapsing the blocks or replacing the duplicate lines with a reference) the amount of text I need to read when when analyzing boot system log file. ...
0
votes
0answers
4 views

Netezza stored procedure dependency tracker

My use case is a business need to reverse engineer legacy stored procedures. I am seeking advice if a tool is able to show a visual or output of object dependencies, data flow or data lineage. These ...
0
votes
0answers
8 views

entity - relationship builder software

i'm looking for some kind of software that would let me create "entities" (people, places, things, etc) with different characteristics (to be set by me) and tags. Then the software should be able to ...
5
votes
0answers
65 views

How to centralize, store and analyse spread out file logs?

TLDR: Our application generates file logs holding bits of information that we'd like to parse them and store in one place, in order to periodically consult them and compute metrics from them (in real ...
1
vote
0answers
11 views

Decoding DTMF tones from recording

I want to teach kids the decoding of alien messages. To get an idea of what aliens could send us, I use the Arecibo message as a first starting point. So I'm trying to decode that message. Wikipedia ...
0
votes
0answers
3 views

Extract metadata from Streaming Data to Automate creation of Data Pipelines

I need some recommendations to Extract metadata from Streaming Data. Do we have any cloud service which can help me in this ? I am looking for metadata like : Format of Data - JSON/AVRO/XML/ ...
0
votes
0answers
8 views

Neural Network for Error Prediction of a Physics Model? [migrated]

I have physical model prediction data as well as actual data. From this I can calculate the error of each prediction data point through simple subtraction. I am hoping to train a neural network to be ...
0
votes
0answers
5 views

Software for checking documents for private / restricted data

Is there any software (preferably free and open source) for checking for protected health information (PHI) in documents / publications? Is there a particular name for software like this? The ...
0
votes
0answers
5 views

Filter, query, and sort data based on fields and tag

Looking for a tool that can help me filter, sort, visualize and query data based on various fields and attributes. Input: All data will have the following similar fields Card Name Power Cost ...
0
votes
0answers
3 views

Easy to use WIndows tool to view HDF5 files and/or convert to CSV

I tried using HDFView (https://www.hdfgroup.org/downloads/hdfview/ ), but it doesn't display the columns clearly. It groups all data columns into an array and removes the column headings when I try ...
0
votes
0answers
7 views

Real time data extraction from DynamoDB

We have an application where the employees are assigned few tasks everyday. On completion of the every task, we are writing the task details to AWS DynamoDB. A sample record is: { "TaskId":"...
0
votes
0answers
2 views

What Analytics Solution Can I Use In Building A Music Streaming Platform?

I am building a music streaming platform using Cloud infrastructure. Services such as Google Firebase, Wowza Stream Engine coding on pure NodeJs. Everything is set except for how to receive analytics ...
4
votes
4answers
81 views

Is there a software tool which allows to perform SQL on CSV files?

I have been trying to find tools which allows me to import a CSV file and perform SQL operations on it. I tried to import on SQL Dev 4 but it does not work without a local connection. The data is ...
0
votes
0answers
4 views

What would be an algorithm to insert something into a cluster based on small information about the item and the items within the cluster?

For an app that I am creating, there will be many clusters of people. Each person will have many small pieces of information such as where they work and some other stuff. Based on this information I ...
0
votes
0answers
7 views

Data correlation tool for personal use

I am interested in finding correlation between different personal daily activities and results. By daily activities, I mean things like: Duration of exercise Duration of sleep Duration of meditation ...
0
votes
1answer
32 views

Recommendation for free cloud deployable BI tool

can anyone recommend a free cloud deployable BI tool that can be used to query data on Apache Spark & to read S3 files through Athena?
0
votes
0answers
10 views

Text analyzer API

I am in the development of a JAVAEE application and one of the requests of the client is to extract information from the text of a document, text that is entered without structure by different ...
0
votes
1answer
11 views

fetching data from website and posting on excel macro [closed]

Is it possible that we can use python or other language to fetch json data from website and posting on ms excel for enterprise purpose
0
votes
0answers
6 views

Software review for Exploratory data analysis and Machine Learning application

What are the advantages and disadvantages of Orange Data Mining tool over Jupyter Notebook, Pycharm, Spyder, etc for detailed Exploratory Data Analysis and Machine Learning Application? I thought I'...
0
votes
0answers
6 views

Alternate Data Stream in Linux

does anyone know any tools that can list the ADS (Alternate Data Streams) of files for LINUX!? I know that this is something specific for NTFS systems (correct me if I'm wrong), I need this tool for ...
0
votes
0answers
4 views

Find relationship between 2 data points

I have data consisting of 2 columns of numbers: 1) A 10 digit id number (each # is unique and sequential) 2) a 4 digit group code (NOT unique) Each ID number is associated with 1 of 40 possible ...
0
votes
0answers
7 views

Software to find duplicate paragraphs or phrases in multiple microsoft word documents

Here is my condition: I have many drafts microsoft word documents. I want to make one microsoft word document. Therefore, I need to find duplicate words or paragraphs copy them into final document ...
1
vote
0answers
5 views

API to analyze ECG readings

I am working on a project where I am taking ECG readings from an AD8232 heart rate monitor. I want to perform analysis on it and know whether the ECG readings are of a healthy person or are there any ...
0
votes
0answers
2 views

Does anyone know about a program extracting data from Instagram?

as I'm currently writing my master thesis in communication sciences, I'd need to know if there is any program extracting data from public Instagram accounts (followers, pictures, likes, comments, ...
0
votes
0answers
4 views

A software to pool kaplan-meier curves for a meta-analysis?

For my meta-analysis I am searching for a handy software to pool all the kaplan-meier curves of various articles to one? I have a mac OS.
1
vote
0answers
17 views

Videoplayer for many 15sec. snippets with easy jumping between snippets (behavior analysis)

I am looking for a video player or way to program in R the following functions: A 10min. long video (or 40 individual 15sec. Videos) is played in 15sec. snippets. I.e. 0-14sec. 15-29sec. and so on. ...
0
votes
0answers
12 views

Framework for calculating dependent values

I am searching for a java library that makes it possible to solve a certain problem. Currently i can't believe that i am the only one in need of something like this and so i think i am just missing ...
0
votes
0answers
13 views

What can i use to implement a data lake?

i am a final year student and i am working on my final year project that consist of implementing a system that automate data management. and for that i am planning to use a data lake to store raw ...
1
vote
0answers
19 views

Python Module for Analyzing User Response

Is there any module available in Python which can help the developer in analyzing customer query and take action/respond accordingly. For example, 1.) Customer Query: Can I have a hot coffee? ...
2
votes
0answers
12 views

R library/package to count cars in distorted images

I have a image recognition task, I have one million pictures and I have to detect how many cars are there in each picture. I'm a middle level R user, a beginer python user, and a midle Java user. ...
1
vote
0answers
21 views

Data Visualization tools - Opensource or licensed?

We have been using Power BI and Qlikview/Qliksense for a while. But despite the best efforts of the Digital/IT team, we are not able to get users to do data visualisation on their own. So the Digital ...
0
votes
0answers
22 views

Need a dashboard that can visualize data from Solr (bonus if also from HBase/HDFS/Spark) and enable drilling down

I need to install Hadoop to perform analysis. I am looking for a robust, open source dashboard that can visualize data from Apache Solr that allows for drilling down in the charts/graphs, which is ...
0
votes
0answers
19 views

How to abstract multiple DB tables?

I need to build a website which is served by live data in RDS (constantly updating data). For every website request we join multiple tables and aggregate data - ex. SUM, AVG. Since we join multiple ...
0
votes
0answers
11 views

(Semantic) Highlighting of any text for improved speed reading

I'm looking for an application that is able to process the (semantic) content of a text and provides an easier-to-read output. I'm imagining an app that takes Text (e.g., in PDF format) and provides a ...
1
vote
0answers
6 views

Home Range/ Kernel Density using Quadrats, not GPS

I am interested in calculating territory size and location for small marine organisms. They dwell in small structures from 50-250mm2. I would be using video to record 2D movements, and would tag their ...
0
votes
1answer
10 views

Python library for running variation of an analysis

I do a fair bit of data analysis using Python. I find that I often end up repeating the same analysis for different input variables (e.g., looking at GDP and then seeing if the answer changes under ...
0
votes
0answers
11 views

Tensorflow Playground customized tool

I am in need of a Tensorflow Playground kind of tool that will help me in visual analytics. If possible it must be using Tensorflow. Also, it should load inputs and output from the file. If not from ...
0
votes
0answers
13 views

Looking for a data collection / reporting / monitoring tool

I'm looking for a shell tool for data collection / analysis / reporting. It should be possible to collect data by simple command line interface, the data should preferably be stored in a backend db (...
-1
votes
1answer
31 views

Daily sales analysis software with charts for very small coffeee shop

can anyone help me please? I run a very small coffee shop. I am after a free or cheap piece of software that will allow me to input my daily takings, and then allow me to compare day vs day, week vs ...
0
votes
1answer
20 views

Collect data about the user navigation in my website

I would like to know if there is any library to start collecting information for a website about: Time in page per user Most common pages visited per user Most visited pages Less visited pages ...
1
vote
0answers
31 views

Asset Management System

I am looking for a system that, preferably, runs "on a cloud instance" such as a paid AWS or other hosted tool that is responsible for asset management. Presently we're running an internally developed ...
1
vote
1answer
32 views

Software to tell whether a file has been “encrypted” by a ransomware attack

I know there are many companies that say that they can help to recover from ransomware attack or can detect and protect. What I am curious about is, can we find out whether a file has been attacked, ...
2
votes
1answer
51 views

How to analyze file and know if messy or encrypted or else?

This is a abstract question for me, hope someone can direct me to one lane. I want to analyze content of file and want to know info like below: Is the dedup ratio high or low before I run dedup on ...
2
votes
0answers
30 views

Time series explorer

Is there software which allows for the exploration of a multi-dimensional time-series? Example exploration For this use case, assume I am monitoring traffic flow throughout a city. I want to see ...