Questions tagged [hadoop]
The hadoop tag has no usage guidance.
16
questions
0
votes
0
answers
31
views
Free alternative to Cloudera Data Platform or Hadoop Data Platform?
I've got 3 identical machines running centos networked to a main machine I'll use as a master node. Looking to install hadoop, spark, hive and probably zepplin. It's just for personal interest, might ...
- 1
2
votes
2
answers
1k
views
Replacement for Apache Sqoop?
Sqoop is retired
What is a good alternative to Sqoop for regular bulk loads to HDFS from a SQL DBMS (Postgres and SQL Server)? I'd like support for splitting across multiple nodes, updating the Hive ...
- 73
1
vote
0
answers
22
views
Distributed FS for storing data in the single "master" node and duplicating that data, which is used on "worker" nodes
I am looking for a DFS for unified data access and caching used files within a small cluster.
We are currently using NFS to RAID node, and it seems not the best way to further scaling. So, I am ...
0
votes
1
answer
35
views
Distributed data storage recommendations in mixed operating system environment for Python applications (Hadoop vs Databricks vs others)
I'm working on a big data project and have several old on-prem servers running a mix of operating systems (Ubuntu, CentOS, Windows 2012, Windows 10). One of the big reasons I would like a distributed ...
- 1
1
vote
0
answers
18
views
Connect Excel to HDFS and update data real time
I am trying to figure out a method or software for updating data into HDFS real time.
My requirement is as follows:
I will have an Excel in a server. That Excel data needs to be loaded into HDFS. IF ...
- 111
1
vote
1
answer
46
views
Operating system for Personal & Enterprise application for Hadoop
I ain't sure if this is a right forum to ask this question. Please let me know which SE site I have to use, in case I am on the wrong forum.
I have started learning Hadoop & I have tried ...
- 111
0
votes
0
answers
195
views
Alternative for HBase to store and query small files
I'm using Hadoop on my system to store my files (each file is very large: ~4GB). I also have small sqlite3 db files (~50MB) and I would like to store them (somewhere - I don't have shared storage) and ...
- 101
2
votes
1
answer
54
views
Deep Learning: is there any open-source library that can be integrated with Hadoop streaming and MapReduce?
Google search popped out quite a few open source deep learning frameworks. Here is a collected list
Google TensorFlow
Theano
mxnet
keras
Pylearn2
Blocks
Lasagne
chainer
scikit-neuralnetwork
theano-...
- 123
1
vote
0
answers
591
views
Python Django with MongoDB with Hadoop
For my Final year project I have to make a big data application. So far the sketch of the overall project includes these three ( Django, MongoDb, Hadoop ).
But I am not sure they will work together ...
- 31
2
votes
0
answers
783
views
Is there any alternative software for JSON Studio?
Is there any alternative software for JSON Studio that would be free to use or probably opensource? I have to use Jsonstudio for its interactivity handling json documents stored in MongoDb. It also ...
- 31
1
vote
0
answers
19
views
What SQL-on-hadoop will be the best solution for my case?
There are so many open source frameworks that help doing analysis by SQL-like query on distributed system.
We are currently looking for good solutions for our case such as Apache Hive, Tajo, Tez, ...
- 111
9
votes
3
answers
828
views
Database for large volume of metrics (key, value, timestamp)
I'm looking for a Database for large amounts of metrics, and i'm confused that there is nothing out there to:
store large amounts (terrabytes) of metrics data in the form:
key (string)
value (...
- 191
2
votes
1
answer
93
views
video storing and synchronous streaming software
I need some software solution for video storing. I will have a few IP cameras which has to stream into disks. This so called database records those streams.On demand I should be able to stream any of ...
4
votes
0
answers
274
views
Which SQL engine atop Hadoop?
Since Hadoop came out, there have been various commercial and/or open-source attempts to expose some compatibility with SQL.
I am seeking one which is good for low-latency querying, and supports the ...
- 141
1
vote
1
answer
229
views
Hadoop JSON Data to Data Warehouse
I'm interested in building a system that allows efficient loading of JSON stored in a Hadoop\EMR-based system to a relational data warehouse. I've already collected large amounts of JSON data in the ...
- 111
2
votes
1
answer
71
views
MapReduce or Hadoop plugin for Eclipse
I am looking for a plugin in Eclipse that can automate some of the work when creating a MapReduce job using Java.
For example:
Auto create Mapper - Reducer classes(implementing the interfaces).
...
- 1,435