Questions tagged [data-analysis]

Data Analysis tools enable you to take a set of data and extract abstract information out of them.

Filter by
Sorted by
Tagged with
1
vote
0answers
7 views

Seeking recommendations - how to anonymise geographic data? [on hold]

I have a set of data set that identifies particular problematic plants around the country, and I want to make this data set public. The issue being that some of the plants are from commercial ...
0
votes
0answers
10 views

Which is the best data visualization software?

I´m looking for a data visualization tool that fits better to my needs. I´ve been searching on Internet and there are lot of different softwares but I have kept in mine some of them which I like: ...
0
votes
0answers
8 views

I've been told to use Azure Data Factory instead of Azure Search

I have a Azure SQL Database that is being updated regularly with link clicks from 1000's of shortener links. I need to access this data and massage it into a JSON api for a dashboard report. I ...
0
votes
0answers
6 views

Simple PHP data analytics/aggregation library

We have one (or more, but one is enough) key-value table that collects stats about various system aspects. Do you know of a simple PHP library that implements predicates like: "daily average of key &...
0
votes
0answers
6 views

Which database is suitable for the analysis of dataset which has 32 byte number( 2 ^ 256 -1 max value)

I want to perform queries and aggregation(like sum and avg) on a dataset which has 32 bytes number data. I initially started with the elastic search but it only supports 8bytes numeric data i.e. long ...
0
votes
0answers
11 views

Can I use AWS Glue to run Apache pig script?

Can I use AWS Glue to run Apache pig script? If not, is there any alternative tool/service in AWS that can run pig jobs? We are moving from on-prem to AWS and want to see which tools would best ...
1
vote
0answers
22 views

Best Tool for Analyzing Multi-Tab Excel Files with 100-500k Records

I have started a new job and I need to analyze client's databases. Many times when we first meet with them we just get a huge Excel file with a dozen or so tabs and a partial to full dump of various ...
1
vote
1answer
16 views

How to “sanitize” different data inputs [closed]

I have an application that has different inputs. Most of them are txt files or CSV/Excel Files. They contain the same type of data, though they are formatted in different ways (order of columns ...
0
votes
1answer
16 views

What is the best statistical software for multiple regression and forecasting with large data input?

We need a robust statistical software that can handle 10~13 million records datasets as an input to support business decisions, mostly forecasting and multiple regressions analysis. We have already ...
0
votes
0answers
6 views

Test data generation tool for outlier detection

I am building a machine learning model for outlier detection. Currently, I do not have a dataset with labeled outliers but I know the patterns of outliers and I have a normal dataset. I need a tool ...
0
votes
0answers
12 views

a tool for analyzing pcap file

i have a file that capture network traffic in format of pcap. i want to extract some information of this pcap file for each class of traffic (http, ftp, ...) . this information is : average Request ...
0
votes
0answers
11 views

How to find complex correlations between several variables?

I am looking for a tool or Python library, to analyse data and (automatically) find correlations between several variables (more than 2, numerical or not). These are the kind of things I would like ...
2
votes
3answers
42 views

File pattern analysis: tool to count frequency of string of bytes

I'm looking for a tool to help me analyze a binary file. There are tools which provide you with rank, the character that appears most of the time, (such as the character that appeared the most times ...
0
votes
0answers
22 views

Is a package similar to the BCDating package in R available in Python?

I have data with TIME, spread, change, duration, amplitude. Some conditions will be added to my Python project. These are duration and amplitude conditions. For example, let's put a 4 sec condition. ...
0
votes
0answers
20 views

Elasticsearch / Kibana Index Access

I’m working on a commercial platform, containing sensitive customer data, we use Elasticsearch on AWS at the minute, for indexing and searching. We’re looking for some advice on implementing a data ...
0
votes
0answers
7 views

How to track bitcoin transactions with python3?

I want to track all bitcoin transactions on a given bitcoin address, and generate graph like this one : Is there some python3 compatible libraries and tutorial to do that kind of things? Thanks a ...
0
votes
0answers
11 views

Recommendations for an ELT tool for Workflow Automation

i get raw data quarterly. Essentially they are dumps from relational database tables. I import them into mysql bounce them against a reference database to get some validated columns then export the ...
0
votes
0answers
5 views

What can be a good tool for reporting the data from DynamoDB

I have a around 4 tables in dynamodb, each not more than 500 mbs of data but might have rows in Billions. Now I am looking for a tool which can take my dynamoDB data as a data source and then in that ...
0
votes
0answers
6 views

Prediction framework for financial data, to develop financial model

My goal is to create a model that can predict the impact of major macroeconomic shocks (ex. Policy changes, trade war…). Like many other models, I am trying to reduce the uncertainty/risk factor as ...
0
votes
0answers
3 views

Analyse massive volume of websites quickly. Cluster Computing? Cloud?

I have a rather large list of domain names, and a rather large set of checks and audits that I have developed to review them all. I intend to attempt to train a machine learning model to make ...
0
votes
0answers
2 views

Tool to find duplicate repeated groups of lines in log files?

I want to use it to reduce (either graphically collapsing the blocks or replacing the duplicate lines with a reference) the amount of text I need to read when when analyzing boot system log file. ...
0
votes
0answers
5 views

Netezza stored procedure dependency tracker

My use case is a business need to reverse engineer legacy stored procedures. I am seeking advice if a tool is able to show a visual or output of object dependencies, data flow or data lineage. These ...
0
votes
0answers
8 views

entity - relationship builder software

i'm looking for some kind of software that would let me create "entities" (people, places, things, etc) with different characteristics (to be set by me) and tags. Then the software should be able to ...
5
votes
0answers
66 views

How to centralize, store and analyse spread out file logs?

TLDR: Our application generates file logs holding bits of information that we'd like to parse them and store in one place, in order to periodically consult them and compute metrics from them (in real ...
1
vote
0answers
46 views

Decoding DTMF tones from recording

I want to teach kids the decoding of alien messages. To get an idea of what aliens could send us, I use the Arecibo message as a first starting point. So I'm trying to decode that message. Wikipedia ...
0
votes
0answers
4 views

Extract metadata from Streaming Data to Automate creation of Data Pipelines

I need some recommendations to Extract metadata from Streaming Data. Do we have any cloud service which can help me in this ? I am looking for metadata like : Format of Data - JSON/AVRO/XML/ ...
0
votes
0answers
5 views

Software for checking documents for private / restricted data

Is there any software (preferably free and open source) for checking for protected health information (PHI) in documents / publications? Is there a particular name for software like this? The ...
0
votes
0answers
5 views

Filter, query, and sort data based on fields and tag

Looking for a tool that can help me filter, sort, visualize and query data based on various fields and attributes. Input: All data will have the following similar fields Card Name Power Cost ...
0
votes
0answers
3 views

Easy to use WIndows tool to view HDF5 files and/or convert to CSV

I tried using HDFView (https://www.hdfgroup.org/downloads/hdfview/ ), but it doesn't display the columns clearly. It groups all data columns into an array and removes the column headings when I try ...
0
votes
0answers
8 views

Real time data extraction from DynamoDB

We have an application where the employees are assigned few tasks everyday. On completion of the every task, we are writing the task details to AWS DynamoDB. A sample record is: { "TaskId":"...
0
votes
0answers
2 views

What Analytics Solution Can I Use In Building A Music Streaming Platform?

I am building a music streaming platform using Cloud infrastructure. Services such as Google Firebase, Wowza Stream Engine coding on pure NodeJs. Everything is set except for how to receive analytics ...
4
votes
4answers
88 views

Is there a software tool which allows to perform SQL on CSV files?

I have been trying to find tools which allows me to import a CSV file and perform SQL operations on it. I tried to import on SQL Dev 4 but it does not work without a local connection. The data is ...
0
votes
0answers
4 views

What would be an algorithm to insert something into a cluster based on small information about the item and the items within the cluster?

For an app that I am creating, there will be many clusters of people. Each person will have many small pieces of information such as where they work and some other stuff. Based on this information I ...
0
votes
0answers
8 views

Data correlation tool for personal use

I am interested in finding correlation between different personal daily activities and results. By daily activities, I mean things like: Duration of exercise Duration of sleep Duration of meditation ...
0
votes
1answer
37 views

Recommendation for free cloud deployable BI tool

can anyone recommend a free cloud deployable BI tool that can be used to query data on Apache Spark & to read S3 files through Athena?
0
votes
0answers
10 views

Text analyzer API

I am in the development of a JAVAEE application and one of the requests of the client is to extract information from the text of a document, text that is entered without structure by different ...
0
votes
1answer
11 views

fetching data from website and posting on excel macro [closed]

Is it possible that we can use python or other language to fetch json data from website and posting on ms excel for enterprise purpose
0
votes
0answers
6 views

Software review for Exploratory data analysis and Machine Learning application

What are the advantages and disadvantages of Orange Data Mining tool over Jupyter Notebook, Pycharm, Spyder, etc for detailed Exploratory Data Analysis and Machine Learning Application? I thought I'...
0
votes
0answers
7 views

Alternate Data Stream in Linux

does anyone know any tools that can list the ADS (Alternate Data Streams) of files for LINUX!? I know that this is something specific for NTFS systems (correct me if I'm wrong), I need this tool for ...
0
votes
0answers
4 views

Find relationship between 2 data points

I have data consisting of 2 columns of numbers: 1) A 10 digit id number (each # is unique and sequential) 2) a 4 digit group code (NOT unique) Each ID number is associated with 1 of 40 possible ...
0
votes
0answers
21 views

Software to find duplicate paragraphs or phrases in multiple microsoft word documents

Here is my condition: I have many drafts microsoft word documents. I want to make one microsoft word document. Therefore, I need to find duplicate words or paragraphs copy them into final document ...
1
vote
0answers
5 views

API to analyze ECG readings

I am working on a project where I am taking ECG readings from an AD8232 heart rate monitor. I want to perform analysis on it and know whether the ECG readings are of a healthy person or are there any ...
0
votes
0answers
2 views

Does anyone know about a program extracting data from Instagram?

as I'm currently writing my master thesis in communication sciences, I'd need to know if there is any program extracting data from public Instagram accounts (followers, pictures, likes, comments, ...
0
votes
0answers
4 views

A software to pool kaplan-meier curves for a meta-analysis?

For my meta-analysis I am searching for a handy software to pool all the kaplan-meier curves of various articles to one? I have a mac OS.
1
vote
0answers
18 views

Videoplayer for many 15sec. snippets with easy jumping between snippets (behavior analysis)

I am looking for a video player or way to program in R the following functions: A 10min. long video (or 40 individual 15sec. Videos) is played in 15sec. snippets. I.e. 0-14sec. 15-29sec. and so on. ...
0
votes
0answers
12 views

Framework for calculating dependent values

I am searching for a java library that makes it possible to solve a certain problem. Currently i can't believe that i am the only one in need of something like this and so i think i am just missing ...
1
vote
0answers
19 views

Python Module for Analyzing User Response

Is there any module available in Python which can help the developer in analyzing customer query and take action/respond accordingly. For example, 1.) Customer Query: Can I have a hot coffee? ...
2
votes
0answers
13 views

R library/package to count cars in distorted images

I have a image recognition task, I have one million pictures and I have to detect how many cars are there in each picture. I'm a middle level R user, a beginer python user, and a midle Java user. ...
1
vote
0answers
22 views

Data Visualization tools - Opensource or licensed?

We have been using Power BI and Qlikview/Qliksense for a while. But despite the best efforts of the Digital/IT team, we are not able to get users to do data visualisation on their own. So the Digital ...
0
votes
0answers
27 views

Need a dashboard that can visualize data from Solr (bonus if also from HBase/HDFS/Spark) and enable drilling down

I need to install Hadoop to perform analysis. I am looking for a robust, open source dashboard that can visualize data from Apache Solr that allows for drilling down in the charts/graphs, which is ...