spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Blue <>
Subject DataSourceV2 community sync tonight
Date Wed, 09 Jan 2019 18:40:00 GMT
Hi everyone,

This is a quick reminder that there is a DSv2 community sync tonight at 5
PM PST. These community syncs are open to anyone that wants to participate.
If you’d like to be added to the invite, please send me a direct message.

The main topic for this sync is the catalog API. To make discussion easier,
I think we should separate the current discussion into a few orthogonal
areas and discuss each:

   - Catalog API plugin system
   - Plan for migration to a new catalog API
   - Catalog API design approach using separate interfaces (TableCatalog,
   UDFCatalog, FunctionCatalog, etc.)
   - TableCatalog API proposal
   implementation, PR #21306 <>
   (not the proposed user-facing API)

If we have time, we can also talk about the user-facing API
proposed in the SPIP.


Ryan Blue
Software Engineer

View raw message