spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Uttam <>
Subject Data quality measurement for streaming data with apache spark
Date Wed, 01 Aug 2018 10:11:35 GMT

I have very general question about Apache Spark. I want to know if it is
possible(and where to start, if possible) to implement a data quality
measurement prototype for streaming data using Apache Spark. Let's say I
want to work on Timeliness or Completeness as a data quality metrics, is
similar work already done using spark? Are there other frameworks which are
better designed for this use case? 

Sent from:

To unsubscribe e-mail:

View raw message