Sean McCoy replied to Bala Krishna Pininti's discussion DMExpress Job : (UNKJOBVER) unknown file version encountered in job file in DMX
"Hi Bala Krishna,
It looks like you are trying to run a task file (.dxt) with the dmxjob command. The dmxjob command is used to run jobs (.dxj files), not tasks.
Use the dmexpress command to run a standalone task. Try "dmexpress /run TestingSyncsort.…"
Feb 17, 2016
Sean McCoy replied to KISHORE VELETI's discussion SyncSort : JOIN / MERGE / COPY / CDC of a Hive table - Output : to a HIve partitioned and bucketed table in DMX for Hadoop
"Hi Kishore,
DMX tasks do support multiple sources and multiple targets. In the Task Editor, you can add more files by choosing Add Source/Target. In DTL, you can have multiple /INFILE and /OUTFILE options.
Also note that there are SourceName() and S…"
Feb 17, 2016
Sean McCoy replied to KISHORE VELETI's discussion CDC - how to run de-dup logic between the files instead of current/previous line times in DMX for Hadoop
"Hi Kishore,
Instead of a join task, it sounds like you want to perform deduplication, which can be achieved with a sort or aggregate task. There are articles on the Syncsort KB that will help you develop a task to perform deduplication:
How to Dedup…"
Feb 17, 2016
Sean McCoy replied to KISHORE VELETI's discussion Sample DTL code for APACHEAVRO and PARQUET FILE FORMAT in DMX for Hadoop
"Hi Kishore,
The issue is that you have specified that "all_layouts.dtl" contains Apache Avro metadata in your second /DATADICTIONARY option. This is incorrect, because it contains DMEXPRESS (DTL) metadata, as indicated by the statement before it.
It…"
Feb 17, 2016