As of May 31, 2023, we have updated our Code of Conduct.

Questions tagged [hadoop]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
31 views

Free alternative to Cloudera Data Platform or Hadoop Data Platform?

I've got 3 identical machines running centos networked to a main machine I'll use as a master node. Looking to install hadoop, spark, hive and probably zepplin. It's just for personal interest, might ...
Tim's user avatar
  • 1
2 votes
2 answers
1k views

Replacement for Apache Sqoop?

Sqoop is retired What is a good alternative to Sqoop for regular bulk loads to HDFS from a SQL DBMS (Postgres and SQL Server)? I'd like support for splitting across multiple nodes, updating the Hive ...
nvogel's user avatar
  • 73
1 vote
0 answers
22 views

Distributed FS for storing data in the single "master" node and duplicating that data, which is used on "worker" nodes

I am looking for a DFS for unified data access and caching used files within a small cluster. We are currently using NFS to RAID node, and it seems not the best way to further scaling. So, I am ...
Sergei Voloboev's user avatar
0 votes
1 answer
35 views

Distributed data storage recommendations in mixed operating system environment for Python applications (Hadoop vs Databricks vs others)

I'm working on a big data project and have several old on-prem servers running a mix of operating systems (Ubuntu, CentOS, Windows 2012, Windows 10). One of the big reasons I would like a distributed ...
dan's user avatar
  • 1
1 vote
0 answers
18 views

Connect Excel to HDFS and update data real time

I am trying to figure out a method or software for updating data into HDFS real time. My requirement is as follows: I will have an Excel in a server. That Excel data needs to be loaded into HDFS. IF ...
Vaishak's user avatar
  • 111
1 vote
1 answer
46 views

Operating system for Personal & Enterprise application for Hadoop

I ain't sure if this is a right forum to ask this question. Please let me know which SE site I have to use, in case I am on the wrong forum. I have started learning Hadoop & I have tried ...
Zerotoinfinity's user avatar
0 votes
0 answers
195 views

Alternative for HBase to store and query small files

I'm using Hadoop on my system to store my files (each file is very large: ~4GB). I also have small sqlite3 db files (~50MB) and I would like to store them (somewhere - I don't have shared storage) and ...
galbru's user avatar
  • 101
2 votes
1 answer
54 views

Deep Learning: is there any open-source library that can be integrated with Hadoop streaming and MapReduce?

Google search popped out quite a few open source deep learning frameworks. Here is a collected list Google TensorFlow Theano mxnet keras Pylearn2 Blocks Lasagne chainer scikit-neuralnetwork theano-...
Osiris's user avatar
  • 123
1 vote
0 answers
591 views

Python Django with MongoDB with Hadoop

For my Final year project I have to make a big data application. So far the sketch of the overall project includes these three ( Django, MongoDb, Hadoop ). But I am not sure they will work together ...
Umer's user avatar
  • 31
2 votes
0 answers
783 views

Is there any alternative software for JSON Studio?

Is there any alternative software for JSON Studio that would be free to use or probably opensource? I have to use Jsonstudio for its interactivity handling json documents stored in MongoDb. It also ...
Umer's user avatar
  • 31
1 vote
0 answers
19 views

What SQL-on-hadoop will be the best solution for my case?

There are so many open source frameworks that help doing analysis by SQL-like query on distributed system. We are currently looking for good solutions for our case such as Apache Hive, Tajo, Tez, ...
Hosang Jeon's user avatar
9 votes
3 answers
828 views

Database for large volume of metrics (key, value, timestamp)

I'm looking for a Database for large amounts of metrics, and i'm confused that there is nothing out there to: store large amounts (terrabytes) of metrics data in the form: key (string) value (...
aep's user avatar
  • 191
2 votes
1 answer
93 views

video storing and synchronous streaming software

I need some software solution for video storing. I will have a few IP cameras which has to stream into disks. This so called database records those streams.On demand I should be able to stream any of ...
Maladec VampaYa's user avatar
4 votes
0 answers
274 views

Which SQL engine atop Hadoop?

Since Hadoop came out, there have been various commercial and/or open-source attempts to expose some compatibility with SQL. I am seeking one which is good for low-latency querying, and supports the ...
Samuel Marks's user avatar
1 vote
1 answer
229 views

Hadoop JSON Data to Data Warehouse

I'm interested in building a system that allows efficient loading of JSON stored in a Hadoop\EMR-based system to a relational data warehouse. I've already collected large amounts of JSON data in the ...
James Errico's user avatar
2 votes
1 answer
71 views

MapReduce or Hadoop plugin for Eclipse

I am looking for a plugin in Eclipse that can automate some of the work when creating a MapReduce job using Java. For example: Auto create Mapper - Reducer classes(implementing the interfaces). ...
dimzak's user avatar
  • 1,435