spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manjunath Shetty H <manjunathshe...@live.com>
Subject Spark ORC store written timestamp as column
Date Thu, 16 Apr 2020 04:47:31 GMT
Hi All,

Is there anyway to store the exact written timestamp in the ORC file through spark ?.
Use case something like `current_timestamp()` function in SQL. Generating in the program will
not be equal to actual write time in ORC/hdfs file.

Any suggestions will be helpful.


Thanks
Manjunath

Mime
View raw message