Join this group if you use the Hadoop version of DMX.

77 Members
Join Us!

Dear All,

I need to develop a custom functions in SyncSort DMX-H using Java/Scala/Groovy i.e other than C / C++. Is it possible to develop, if yes could you please share the documentation for the same.

Below is my requirement :

Left hand side is a data value in raw format and I need to convert it into right hand side format i.e. eventually into ISO format. We are missing seconds when we try to convert using TO_DATE function.

Could you please suggest a better solution to handle this in SyncSort DMX-H (this is a column value from one Hive table to another Hive table)

2015-04-29-14.20.10.574372 ->  2015-04-29 14:20:10.574372
 
08-NOV-25 13.00.00.123450 -> 2015-08-25 13:00:00.123450
 
17-OCT-15 06.57.26.245552 PM -> 2015-10-17 18:57:26.245552

Thanks,

Kishore Veleti A.V.K.

You need to be a member of Syncsort Community to add comments!

Join Syncsort Community

Email me when people reply –

Replies

  • Kishore,

    I am not sure I understand what you are looking to do based on your examples. The formats on the left side seem to be different. 

    In general though, DMX-h supports Hive tables and if the data is defined in Hive as a Datetime type then DMX should be able to handle it. If you are looking to change the format of the data you can use a datetime mask in your reformat to change the format of the date and only include the components you want.

    Does that help?

    Thanks,

    Chris

This reply was deleted.

To access Syncsort Knowledge Base, visit:

My Support