7

You can also try ElasticSearch. ElasticSearch it's a search server on top of Lucene. It provides a Json API for performing the search queries and it's really handy when it comes to scalability. In order to to index an existing database you should continually poll it's content. Here is a tutorial for that. On the downside, you should be familiar with ...


6

I would suggest taking a look at python/iPython & pandas data visualization. Interactive in web browser with iPython & Scriptable Pivot tables are a single line: e.g.: df.pivot(index='date', columns='variable', values='value') From this really nice example by Chris Moffitt. Calculated fields no problem at all - this is Pandas Can directly read/...


5

You can use Eclipse with the Eclipse Data Tools Platform: SQL querying (with a GUI to create create queries visually) Can be connected to SQL Server, Oracle and MySQL. Can run on Windows and Linux distros DDL Manipulation Create/edit stored procedures, triggers. support for JDBC connections PS: Toad is Windows only but otherwise it is a great tool and has ...


5

Well, you said the 3 magic words: database, text-search and Java. I would strongly suggest using Hibernate-Search because it's made for this purpose. To be more precise, Hibernate-Search has the ability to: Add text-search in your existing database by annotations in your existing entities. find by approximation (fuzzy search) and rank results. It's Lucene ...


5

Solr might be a good fit for your choice. As ElasticSearch, Solr is based on Lucene and provides the same functionalities like full-text search, hit highlighting and easy-scalability among others. Generally when searching for those 2 solutions you will find many resources. I leave it to you to decide which one to use ;) Solr has definitely the advantage ...


5

The 'problem' with a CSV file is that the single 'table' doesn't have a name. Therefore, you'll need to define a table (including columns) and import the CSV file before doing any SQL queries on it. Almost all database browsers offer import from CSV; if you want a lightweight one, I can recommend SQLite Browser. It's open-source, cross platform (Windows, ...


4

I would be surprised if you find any API combining those features. As the two most useful features are certainly the picture and the name by far, I would use a Face gender detection API such as Lambda Labs's API (picked randomly, you might want to search for benchmark if there are any), combined with a name to gender mapping. To solve the conflicts , you ...


4

For a much more advanced tool, you can use Wordstat: non-free but 30-day trial tons of features, including frequency analysis on keywords, phrases, derived categories or concepts, or user-defined codes entered manually within a text:


4

There are a couple of python libraries that can do this python-phonenumbers will parse various formats to get the country code. Free & Open Source. Works offline Cross platform & OS Python 2.5-2.7 & 3.x Pure Python so no C compiler needed. Based on the examples from that page and using ipython: In [1]: import phonenumbers In [2]: from ...


3

I am the author of Detect It Easy (DIE). It is cross platform (Windows, OS and Linux). Free Commercial use is fine. Anybody can use DIE free and without any restrictions whether the usage is commercial or not. If you need more information: horsicq[at]gmail.com


3

To address your first issue: I am experienced with PHP as a server side script and MYSQL. I am confused on the database side ? When you were developing in PHP, MySQL was the tool you used to manage your data. Your app used it for creating, reading, updating or deleting (CRUD) records/entities/rows of information. If you were given an instance/virtual ...


3

You can use http://textalyser.net/: free online perform word frequency analysis:


3

Try R with R Studio it has all the features you are looking for. R is a language developed over statistical functions in FORTRAN that is used well basically for doing statistical operations. R Studio is a GUI & IDE type of interface built over R that could make your workflow easier R - http://www.r-project.org/ R Studio - https://www.rstudio.com/


3

It's possible to convert .pdf document to a text file. After doing that it should be possible to extract a piece of text depending on how regular will it be using regular expressions. You did not specify what OS you are using but on *nix it's possible to automate this using pdftotext command line tool and a combination of grep/sed/cut/awk/perl. To download/...


3

You don't mention where these data are stored, so I guess it's on a database. If you are looking for something Open Source, Free and on-premises have a look at Metabase. It takes really just 5 minutes, if not under to get your first graph on the screen. Currently, it supports the following databases: MySQL Postgres Mongo SQL Server AWS Redshift Google ...


2

You can use the module sklearn.cluster from the Python library scikit-learn (free and open-source). E.g. if you want to use the k-means algorithm: import numpy as np from sklearn.cluster import KMeans kmeans_model = KMeans(n_clusters=3, random_state=1).fit(X) labels = kmeans_model.labels_ metrics.silhouette_score(X, labels, metric='euclidean')


2

Since you are going to end up in python anyway why not just read the Excel file directly using python in the first place, and do whatever processing you want there? I use xlrd for python all the time and it works great. http://installion.co.uk/ubuntu/saucy/universe/p/python-xlrd/install.html Not xubuntu specific but should get close enough


2

You can give a try 0xDBE from JetBrains. It's early access but looks like quite handy tool. It supports many DB engines: Oracle, MySQL, PostgreSQL, H2, Apache Derby, Sybase, DB2, SQLite, SQLServer and few others. Main features: Code Completion Renaming and Finding Usages Code Analysis and Quick-fixes Powerful Editor Code Formatting Slick Table Editor ...


2

First of all, you may want to split your data set into cities. This will probably yield better results than keeping everything together. Then the tool of choice probably is ELKI: It contains lots and lots of algorithms for outlier detection. In particular, it has the Local Outlier Factor (wikipedia), which exactly tries to capture local differences in ...


2

Is there a way to do these two calculations with a software? Yes. Assuming that you are OK to pay money in order to avoid doing (much if any) coding, I recommend Igor Pro. Search the IgorExchange site for questions along the lines of what you ask. Assuming that you want to do it (mostly or almost entirely) for free and you are not really all that serious ...


2

Eureqa is designed for finding correlations (including non-linear multi-variable complicated ones). It does not work for big dataset hovewer, so you can use it on partial data. You can try inserting limited set of data into the online version to see "low hanging fruit" correlations in your data. Unfortunately, it is not FOSS.


2

If your computer has enough RAM, you could completely read and process the file with R, optionally using the data.table package. From your description, you have a long time series of sensor readings and would like to model the system to be able to predict behaviour. This is a very complex topic that I'm not familiar with, but R packages, like "forecast" ...


2

You can ofcourse use pure-perl library too. Here is an working script: #!/usr/bin/env perl use 5.014; use warnings; use Number::Phone::Country; use Locale::Country; for my $arg (@ARGV) { #get ISO country code and IDD from the number my($iso_cc, $idd) = Number::Phone::Country::phone2country_and_idd($arg); unless($iso_cc) { warn "Bad ...


2

Am using PostgreSQL(open source database) on my VB.NET Desktop Application. I think you need an embedded database to use within the application, Microsoft SQL Server Compact if you don't want to install anything on the user side Firebird Embedded Firebird Embedded is a relational database engine. It's an open source fork of InterBase, is ACID ...


2

I think that you need to take a look at SigRock: Python Open Source Cross Platform Plug in decoders including I2C Works with a variety of hardware or file captures, you may need to do a little work on manipulating your data to a binary signal chain.


2

The software that I've used in the past to come up with best-fit curves is LoggerPro by Vernier. It's really powerful and has many different options. It should be able to calculate an equation of the best fit curve (if you give me the data, I can try it now). LoggerPro does have a demo here along with a lite version, Logger Lite. Logger Pro (commercial w/ ...


2

Is there an IDE that correctly displays pandas dataframes? PyCharm released version 2016.2 (a week after I posted this question!), which includes a pandas dataframe viewer. I still want to know if software exists that allows easy, ipython-like manipulation of such "local-variable" dataframes.


2

Gnuplot should fit your needs. It's a portable command-line driven graphing utility for Linux, OS/2, MS Windows, OSX, VMS, and many other platforms. It's relatively easy to use and you will find many tutorials around the internet. Supports many outputs formats like pdf, png, gif, jpeg, LaTeX, metafont, emf, svg and HTML5. According to the demonstrations ...


2

There is - the combination of python/jupyter and Pandas is excellent for this sort of thing. Open Source & Gratis Read large CSV files Lots of data analysis & visualisation tools Cross platform Lots of output options To detect sentiments in each review you are looking at a natural language toolkit such as nltk.


Only top voted, non community-wiki answers of a minimum length are eligible