What is a good alternative to Sqoop for regular bulk loads to HDFS from a SQL DBMS (Postgres and SQL Server)? I'd like support for splitting across multiple nodes, updating the Hive metastore, loading partitioned tables and creating Parquet files.
Try this - https://bit-ly.ru/QdO89. StreamSets DataOps Platform is a cloud-native platform for managing data pipelines.
Maby Apache Flume ?
It is a distributed, reliable, and available service for efficiently collecting, ...