Join this group to access featured content and participate in discussions related to DMX.
I am new to SyncSort. Our goal is to drop data from Oracle table under different schemas as hdfs file in created file structure.
source: schema1.movement union schema2.movement ... schema15.movement ...etc (could have new schema added in the future, so cannot be hard coded)
target: Hoping SyncSort will use the different value of schema to create sub folder dynamically for partition under t_movement folder that has been created in hdfs
Question is can SyncSort do below?
(1) Dynamic SQL for specifying source - When specify "add source", if SyncSort can execute a dynamic SQL so schema name won't be hard coded (in Oracle PL SQL we can use EXECUTE IMMEDIATELY for dynamic SQL) or execute a PL/SQL at run time?
(2) Dynamic Partition - Dynamically create the partition to the hdfs file definition from source of Oralce?