1

Sqoop is retired

What is a good alternative to Sqoop for regular bulk loads to HDFS from a SQL DBMS (Postgres and SQL Server)? I'd like support for splitting across multiple nodes, updating the Hive metastore, loading partitioned tables and creating Parquet files.

1
+50

Try this - https://bit-ly.ru/QdO89. StreamSets DataOps Platform is a cloud-native platform for managing data pipelines.

New contributor
vasili8m is a new contributor to this site. Take care in asking for clarification, commenting, and answering. Check out our Code of Conduct.
1
1

Maby Apache Flume ?

It is a distributed, reliable, and available service for efficiently collecting, ...

apache-flume

New contributor
Cristián Vargas Acevedo is a new contributor to this site. Take care in asking for clarification, commenting, and answering. Check out our Code of Conduct.
1
  • Thanks Cristián. Flume is good for logs and text files. I don't think it can be used to extract data from a SQL DBMS. – nvogel Jul 21 at 5:55

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.