spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joseph Torres <joseph.tor...@databricks.com>
Subject [DISCUSS] Structured Streaming writers in DataSourceV2
Date Fri, 09 Mar 2018 18:22:57 GMT
Hi all,

I've been working for the past few months on figuring out a DataSourceV2
compatible interface for Structured Streaming sinks. I've written a document
<https://docs.google.com/document/d/1PJYfb68s2AG7joRWbhrgpEWhrsPqbhyRwUVl9V1wPOE>
proposing
an overarching design; please take a look and leave any comments you have.


Design doc JIRA: SPARK-23556
<https://issues.apache.org/jira/browse/SPARK-23556>
DataSourceV2: SPARK-15689
<https://issues.apache.org/jira/browse/SPARK-15689>

Jose

Mime
View raw message