spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "lk_spark"<lk_sp...@163.com>
Subject how to get spark-sql lineage
Date Thu, 16 May 2019 02:44:31 GMT
hi,all:
        When I use spark , if I run some SQL to do ETL how can I get lineage info. I found
that , CDH spark have some config about lineage :
        spark.lineage.enabled=true
        spark.lineage.log.dir=/var/log/spark2/lineage
        Are they also work for apache spark ?

2019-05-16


lk_spark 
Mime
View raw message