spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hyukjin Kwon <>
Subject Re: [PySpark] Revisiting PySpark type annotations
Date Fri, 28 Aug 2020 01:06:29 GMT
Thanks Maciej and Fokko.

2020년 8월 28일 (금) 오전 6:09, Maciej <>님이 작성:

> On my side, I'll try to identify any possible problems by the end of the
> week or so (at somewhat crude inspection there is nothing unexpected or
> particularly hard to resolve, but sometimes problem occur when you try to
> refine things) and I'll post an update. Maybe we could take it from there?
> In general I'd expect that there will be some work to be done in the
> following areas
>    - Providing at least basic contributor guidelines ‒ as already
>    discussed annotations can server different purpose and take different
>    approach to certain issues. I expect this might evolve over time, but it
>    might be nice to have something to start.
>    - CI pipeline. Codebase MyPy tests are usually not sufficient ‒ right
>    now I test against patched examples and using some additional data driven
>    case, but once combined, we can explore other options (doctests are nice
>    lead)
> In short term there are also some upstream changes that haven't been
> reflected in stubs master...
> On 8/27/20 10:24 PM, Driesprong, Fokko wrote:
> . Any action points that we can define and that I can help on? I'm fine
> with taking the route that Hyukjin suggests :)
> --
> Best regards,
> Maciej Szymkiewicz
> Web:
> Keybase:
> Gigs:
> PGP: A30CEF0C31A501EC

View raw message