Questions tagged [hadoop]
The hadoop tag has no usage guidance.
Free alternative to Cloudera Data Platform or Hadoop Data Platform?
I've got 3 identical machines running centos networked to a main machine I'll use as a master node. Looking to install hadoop, spark, hive and probably zepplin. It's just for personal interest, might ...
Replacement for Apache Sqoop?
Sqoop is retired What is a good alternative to Sqoop for regular bulk loads to HDFS from a SQL DBMS (Postgres and SQL Server)? I'd like support for splitting across multiple nodes, updating the Hive ...
Distributed FS for storing data in the single "master" node and duplicating that data, which is used on "worker" nodes
I am looking for a DFS for unified data access and caching used files within a small cluster. We are currently using NFS to RAID node, and it seems not the best way to further scaling. So, I am ...
Distributed data storage recommendations in mixed operating system environment for Python applications (Hadoop vs Databricks vs others)
I'm working on a big data project and have several old on-prem servers running a mix of operating systems (Ubuntu, CentOS, Windows 2012, Windows 10). One of the big reasons I would like a distributed ...
Connect Excel to HDFS and update data real time
I am trying to figure out a method or software for updating data into HDFS real time. My requirement is as follows: I will have an Excel in a server. That Excel data needs to be loaded into HDFS. IF ...
Operating system for Personal & Enterprise application for Hadoop
I ain't sure if this is a right forum to ask this question. Please let me know which SE site I have to use, in case I am on the wrong forum. I have started learning Hadoop & I have tried ...
Alternative for HBase to store and query small files
I'm using Hadoop on my system to store my files (each file is very large: ~4GB). I also have small sqlite3 db files (~50MB) and I would like to store them (somewhere - I don't have shared storage) and ...
Deep Learning: is there any open-source library that can be integrated with Hadoop streaming and MapReduce?
Google search popped out quite a few open source deep learning frameworks. Here is a collected list Google TensorFlow Theano mxnet keras Pylearn2 Blocks Lasagne chainer scikit-neuralnetwork theano-...
Python Django with MongoDB with Hadoop
For my Final year project I have to make a big data application. So far the sketch of the overall project includes these three ( Django, MongoDb, Hadoop ). But I am not sure they will work together ...
Is there any alternative software for JSON Studio?
Is there any alternative software for JSON Studio that would be free to use or probably opensource? I have to use Jsonstudio for its interactivity handling json documents stored in MongoDb. It also ...
What SQL-on-hadoop will be the best solution for my case?
There are so many open source frameworks that help doing analysis by SQL-like query on distributed system. We are currently looking for good solutions for our case such as Apache Hive, Tajo, Tez, ...
Database for large volume of metrics (key, value, timestamp)
I'm looking for a Database for large amounts of metrics, and i'm confused that there is nothing out there to: store large amounts (terrabytes) of metrics data in the form: key (string) value (...
video storing and synchronous streaming software
I need some software solution for video storing. I will have a few IP cameras which has to stream into disks. This so called database records those streams.On demand I should be able to stream any of ...
Which SQL engine atop Hadoop?
Since Hadoop came out, there have been various commercial and/or open-source attempts to expose some compatibility with SQL. I am seeking one which is good for low-latency querying, and supports the ...
Hadoop JSON Data to Data Warehouse
I'm interested in building a system that allows efficient loading of JSON stored in a Hadoop\EMR-based system to a relational data warehouse. I've already collected large amounts of JSON data in the ...
MapReduce or Hadoop plugin for Eclipse
I am looking for a plugin in Eclipse that can automate some of the work when creating a MapReduce job using Java. For example: Auto create Mapper - Reducer classes(implementing the interfaces). ...