Questions tagged [hadoop]
The hadoop tag has no usage guidance.
16
questions
1
vote
2answers
246 views
Replacement for Apache Sqoop?
Sqoop is retired
What is a good alternative to Sqoop for regular bulk loads to HDFS from a SQL DBMS (Postgres and SQL Server)? I'd like support for splitting across multiple nodes, updating the Hive ...
1
vote
0answers
22 views
Distributed FS for storing data in the single "master" node and duplicating that data, which is used on "worker" nodes
I am looking for a DFS for unified data access and caching used files within a small cluster.
We are currently using NFS to RAID node, and it seems not the best way to further scaling. So, I am ...
0
votes
1answer
29 views
Distributed data storage recommendations in mixed operating system environment for Python applications (Hadoop vs Databricks vs others)
I'm working on a big data project and have several old on-prem servers running a mix of operating systems (Ubuntu, CentOS, Windows 2012, Windows 10). One of the big reasons I would like a distributed ...
1
vote
0answers
16 views
Connect Excel to HDFS and update data real time
I am trying to figure out a method or software for updating data into HDFS real time.
My requirement is as follows:
I will have an Excel in a server. That Excel data needs to be loaded into HDFS. IF ...
1
vote
1answer
41 views
Operating system for Personal & Enterprise application for Hadoop
I ain't sure if this is a right forum to ask this question. Please let me know which SE site I have to use, in case I am on the wrong forum.
I have started learning Hadoop & I have tried ...
0
votes
0answers
173 views
Suggestions for Distributed File System
Current Configuration:
No of machines: 7-8
Hard Disk in each: 400 GB
Memory in each machine: 60 GB
Requirements:
Each program can access many files. Since program is in c++, some interface in ...
0
votes
0answers
188 views
Alternative for HBase to store and query small files
I'm using Hadoop on my system to store my files (each file is very large: ~4GB). I also have small sqlite3 db files (~50MB) and I would like to store them (somewhere - I don't have shared storage) and ...
2
votes
1answer
49 views
Deep Learning: is there any open-source library that can be integrated with Hadoop streaming and MapReduce?
Google search popped out quite a few open source deep learning frameworks. Here is a collected list
Google TensorFlow
Theano
mxnet
keras
Pylearn2
Blocks
Lasagne
chainer
scikit-neuralnetwork
theano-...
1
vote
0answers
563 views
Python Django with MongoDB with Hadoop
For my Final year project I have to make a big data application. So far the sketch of the overall project includes these three ( Django, MongoDb, Hadoop ).
But I am not sure they will work together ...
2
votes
0answers
774 views
Is there any alternative software for JSON Studio?
Is there any alternative software for JSON Studio that would be free to use or probably opensource? I have to use Jsonstudio for its interactivity handling json documents stored in MongoDb. It also ...
1
vote
0answers
19 views
What SQL-on-hadoop will be the best solution for my case?
There are so many open source frameworks that help doing analysis by SQL-like query on distributed system.
We are currently looking for good solutions for our case such as Apache Hive, Tajo, Tez, ...
8
votes
3answers
795 views
Database for large volume of metrics (key, value, timestamp)
I'm looking for a Database for large amounts of metrics, and i'm confused that there is nothing out there to:
store large amounts (terrabytes) of metrics data in the form:
key (string)
value (...
2
votes
1answer
90 views
video storing and synchronous streaming software
I need some software solution for video storing. I will have a few IP cameras which has to stream into disks. This so called database records those streams.On demand I should be able to stream any of ...
4
votes
0answers
266 views
Which SQL engine atop Hadoop?
Since Hadoop came out, there have been various commercial and/or open-source attempts to expose some compatibility with SQL.
I am seeking one which is good for low-latency querying, and supports the ...
1
vote
1answer
223 views
Hadoop JSON Data to Data Warehouse
I'm interested in building a system that allows efficient loading of JSON stored in a Hadoop\EMR-based system to a relational data warehouse. I've already collected large amounts of JSON data in the ...
2
votes
1answer
71 views
MapReduce or Hadoop plugin for Eclipse
I am looking for a plugin in Eclipse that can automate some of the work when creating a MapReduce job using Java.
For example:
Auto create Mapper - Reducer classes(implementing the interfaces).
...
