Questions tagged [data-analysis]

Data Analysis tools enable you to take a set of data and extract abstract information out of them.

Filter by
Sorted by
Tagged with
15
votes
2answers
6k views

Detect repeated sentences or phrases in a document

I want to detect sentences, long phrases, and possibly paragraphs that have been repeated in a document. I've been working on a document, and want to make sure I haven't copied the same or similar ...
13
votes
2answers
212 views

HR performance management system

I am looking for software similar to workday or successfactors for HR performance management system. But the examples I mentioned are a bit expensive. The main purpose of the software is to monitor ...
12
votes
2answers
176 views

Data analysis/plotting on OS X

I am searching for an easy to use software for OS X that is capable of the following: data analysis (load/process/manipulate data) via scripting plotting the data configuring the plot directly (not ...
10
votes
9answers
5k views

Is there a software tool which allows to perform SQL on CSV files?

I have been trying to find tools which allows me to import a CSV file and perform SQL operations on it. I tried to import on SQL Dev 4 but it does not work without a local connection. The data is ...
7
votes
4answers
1k views

Heatmap chart generator for table/matrix data

I have some numeric data in matrix form, which for the sake of discussion is the values of some function f(x,y) sampled at some discrete grid. This data is, say, in a .csv file or in an .ods (...
6
votes
3answers
2k views

What is a good open source information retrieval library (search engine)?

So I have a Java application running on a websphere server. The server has an oracle database of boxes. Each box has a list of things in it. Each thing has a main description (input as text from ...
6
votes
2answers
683 views

Gender-Recognition API

Does anyone know of any API's out there that can determine gender based on a few of the following: Name Username Posts/Text/How they Talk Location Profile Description Picture Or if such an API ...
5
votes
2answers
1k views

Library that tells country from phone number

I have a thousand of phone numbers like +27823374587 Is there a library or command-line program that can tell me the country? For instance: +27823374587 → South Africa Requirements: Runs offline ...
5
votes
2answers
589 views

File signature detection tool

Is there a PE (portable executable) signature detection tool which allows commercial use? Here's what I tried so far: Exeinfo PE is free for non-commercial use. No information available regarding ...
5
votes
1answer
1k views

IDE with debugger able to view and manipulate python pandas dataframes?

I'm conducting data science on medium-size datasets (~5000 entries with ~100 fields) that include input by humans. I am using the pandas python module developed by Wes McKinney. I spend a lot of ...
5
votes
1answer
100 views

Graphing software for best fit curve

I am looking for a specific graphing software that can take in values for X axis and Y axis and then output a best fit curve. By using Excel 2010, I am able to output this nice curve: However, I ...
5
votes
1answer
723 views

Outlier detection in latitude/longitude CSV file

I have a huge CSV file containing GPS points of hotels in various cities. Sample: CITY | HOTEL | LATITUDE | LONGITUDE Chicago | Bellevue | 41.826 | -87.689 Chicago | SuperMt | 41.924 | -...
5
votes
1answer
56 views

Is there a software available which maps social networks?

I'm wondering if there is already a software available, which can map social networks using publicly available online information. For example, it would be interesting if I could input my name and ...
5
votes
0answers
72 views

How to centralize, store and analyse spread out file logs?

TLDR: Our application generates file logs holding bits of information that we'd like to parse them and store in one place, in order to periodically consult them and compute metrics from them (in real ...
4
votes
3answers
3k views

Linux alternative to Excel pivot table

My company uses some simple MySQL queries to generate a CSV report of a bunch of stats (about 20 columns, rows in the low thousands). We then use Microsoft Excel to create pivot tables to explore and ...
4
votes
2answers
342 views

Word frequency analyzer

I am a translator by night and would like to analyze the texts that I've previously written. Specifically, I'd like to focus the time I spend memorizing vocabulary by knowing which of the "trouble" ...
4
votes
3answers
78 views

Software to search for correlation in data

I'm searching for a software where I can import a large amount of data (5000 columns, unknown number of rows, about 20gb) and the software gives me a estimate correlation (does not have to be very ...
4
votes
1answer
129 views

Database/Scripting Language suggestion for a project involving heavy inserts? [closed]

I am looking into a project which involves large number of inserts daily.I will have a list of user's (for example a user set of 500k ) , for which I need to monitor daily certain activities ...
4
votes
1answer
78 views

Database technology recomendation for simulator

Alright so I am developing a simulation application and I need to know what database is advisable (Or the pro's con's of some options). tl;dr: C# application Only the application will be using it ...
4
votes
1answer
125 views

Aquachem open source Alternative

I have a bulk of water quality data I have to comprehensively analyze and I attempted to use waterloo aquachem 2014.2 software trial version which had numerous hurdles. Considering that and the fact ...
4
votes
2answers
295 views

SQL tool that can use query result sets as temporary tables for further analysis and set operations?

For examples, lets say I need to do set operations and joins on below result sets from 3 different SQL queries: I don't want to write a composite query with subqueries, or use temporary database ...
4
votes
1answer
57 views

Tool for Customer Support + Analytics

I run a customer support and user analytics team at a software startup. We get 2000+ tickets each day. 90%+ do not need any answer, they just need for me to analyse the problem and pass the info to ...
4
votes
1answer
44 views

Application to browse time stamped data of different type

Application to browse time stamped data of different types (email, phone call, sms, photo, document, web browser history, ...) as one timeline to scroll through. Requirements OS: Linux, preferably ...
4
votes
0answers
356 views

Open source .NET library for automatic Russian text summarization

I need a library to automatically summarize a text written in Russian. Requirements: Summarize a text (for instance from 5000 characters to 500 characters) Works with Russian Open source Usable from ...
3
votes
3answers
576 views

SQL Server/Oracle/MySQL database tool for developers (DDL Manipulation, stored procedures, triggers, OLEDB, ADO.NET)

I'm looking for a Database tool for developers with the following features: SQL querying Can be connected to SQL Server, Oracle and MySQL. Can run on Windows and Linux distros DDL Manipulation (...
3
votes
2answers
52 views

What would be a suitable tool to do time series data comparison?

The running of an industrial process I'm in charge of produces time series data (approximately several thousand parameters, each 1/8th of a second, during a month). My goal is to look at two month-...
3
votes
4answers
213 views

Tools for big CSV files manipulations

I'm working with a huge CSV dataset and I'm now make some pre-processing on it. The pre-processing consists of removing lines with "not a numbers", change columns positions or remove lines. Is there ...
3
votes
1answer
77 views

Basic binning software for data analysis (no coding)

I have a set of data (X and Y) and I need to do the following two types of binning: Procedure A (constant steps) Finds the max and min in X Divide this interval in a number of bins chosen by me For ...
3
votes
2answers
83 views

DataWarehousing and Big Data

I'm designing a Data Warehouse system. I need a program that gets: multiple datatypes, joins them and then perform fast queries on them. Since the sources are in the order of 250 GB (per table) I ...
3
votes
1answer
47 views

Dataset insights software

If I have a set of data in whatever format, CSV, JSON, etc. I wanted to throw it at machine learning algorithms and be able to extract some correlation facts from these datasets. Some of the things ...
3
votes
1answer
534 views

What is a good alternative to Zoho Reports?

What other services are similar to Zoho Reports? I performed a search for alternatives and all articles seemed to focus on the CRM and so it was a false comparison. Al the alternatives were about CRM ...
3
votes
2answers
115 views

Looking for an app to track all foods eaten and how I felt

I am looking for an app (It should work on Android and ideally on Windows or browsers) to be able to precisely track all foods eaten. I am not interested in anything too complex, and I do not want ...
3
votes
0answers
82 views

Check whether car exceeded speed limit between some waypoints GPX

I need a free software to check whether racing car exceeded speed limit between some waypoints. There are two .gpx files - one has waypoints and another has car track with speeds. I need something ...
3
votes
0answers
33 views

What software can be used to create logic from datasets?

I need a software that can import a dataset (excel/CSV table) and I can write formulas/create a workflow logic to export into another (excel/CSV) table. I need this software to be able to be deployed ...
3
votes
0answers
25 views

Software for analyzing lengthy, fixed perspective footage

I have several hours of footage sitting on my hard drive that I need to analyze. Each recording is from a camera that's pointed towards a location and I'm looking for any software that can tell me ...
3
votes
0answers
110 views

How can I compare two blobs in c# in a way so I can patch it later

I would like to write a program which compares two byte[] blob and returns the difference and a parch object so i can apply the patch on the original blob and get the other. Is there any library out ...
2
votes
5answers
103 views

Is there a better software/library towards analytics (and visualisation)?

I've got product data (time, title, price, likes, colour, etc.) from several shops and I would like to do some analysis on it. Some are quite easy: Total amount of products per shop Pie Chart of ...
2
votes
1answer
118 views

What software do I need to convert a pdf to text that can then be processed using regex to extract specific pieces of data?

I have a bunch of pdf files/forms that are all in a standardized format. They contain information such version history, author, who signed the document, and what documents it references. I need to ...
2
votes
2answers
89 views

Need a reporting suite, semi-disparate data, small learning curve, web based deliverable

I'll lay out the specifics of my current situation. We have > 1000 reports that we manage on a regular basis. Current tools are built in Excel with VBA running the interactivity of the workbook (...
2
votes
1answer
108 views

Python libraries for clustering decimals

I have a collection of decimals, with each a value between 0.0 and 1.0. I would like to "cluster" them by value on two dimensions, so that decimals with near values are grouped together, yet spaced ...
2
votes
1answer
64 views

How to analyze file and know if messy or encrypted or else?

This is a abstract question for me, hope someone can direct me to one lane. I want to analyze content of file and want to know info like below: Is the dedup ratio high or low before I run dedup on ...
2
votes
1answer
243 views

Command line tool to analyze amount of motion in video file

I am looking for a command-line-ready tool that will work on Linux which will be able to give me a value (or small set of values) which represent the amount of motion present in a given video file. ...
2
votes
1answer
38 views

Field Data Collection and Automation

My company deals with Close Interval Surveys. We are trying to limit the time spent in the office compiling reports once the source data is collected from the field. My question, is there some type of ...
2
votes
2answers
53 views

Return unique report/list/table based on user entered criteria pushed through series of decision trees

I am looking for an application that will allow me to have a user answer a series of dynamic questions. At the end of the process, a table or report will be generated with information unique to each ...
2
votes
1answer
61 views

Data analysis software connecting to excel

I'm wondering which software would best be suitable for: plotting data, possibly interactive graphics statistics reading and writing excel files (numbers, currencies, enums, dates, possibly text) ...
2
votes
3answers
385 views

MySQL data explorer / data analysis tool

I am looking for a tool which will connect to a MySQL database and, given a table name, will allow me to analyze the data in the table. I would like to be able to (the most important features first):...
2
votes
1answer
135 views

Free alternative to DataRPM (Report Analysis for Big data)

I'm looking for a browser based FREE or OPEN-SOURCE alternative to DataRPM. Data RPM is a software for discovering reports of information based on large data. Saw a demo of the software some time ago,...
2
votes
0answers
111 views

Recommendations for a graphics library for real-time display of geospatial data

I'm looking for recommendations on graphics libraries or game engines that would facilitate semi-realtime plotting or playback of local cartesian or geospatial data. Here are some details on use case ...
2
votes
0answers
27 views

Linux tool to anonymize captured data packets for commercial use according to GDPR

I am working on a project where I have to identify anomalies in network traffic of business networks with machine learning. The algorithm is feeded with captured network packets from inside of the ...
2
votes
0answers
15 views

Application that links anonymously written text to an identity

I just wondered whether there is a tool, which can link anonymously written text to an identity. Like a tool that could be trained with some data and would - by analyzing grammar, words, punctuation ...