spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andy Davidson <A...@SantaCruzIntegration.com>
Subject FW: [jupyter] newbie. apache spark python3 'Jupyter' data frame problem with auto completion and accessing documentation
Date Tue, 02 Aug 2016 16:57:36 GMT
FYI

From:  <jupyter@googlegroups.com> on behalf of Thomas Kluyver
<takowl@gmail.com>
Reply-To:  <jupyter@googlegroups.com>
Date:  Tuesday, August 2, 2016 at 3:26 AM
To:  Project Jupyter <jupyter@googlegroups.com>
Subject:  Re: [jupyter] newbie. apache spark python3 'Jupyter' data frame
problem with auto completion and accessing documentation

> Hi Andy,
> 
> On 1 August 2016 at 22:46, Andy Davidson <Andy@santacruzintegration.com>
> wrote:
>> I wonder if the auto completion problem as todo with the way code is
>> typically written in spark. I.E. By creating chains of function alls? Each
>> function returns a data frame.
>> 
>> hashTagsDF.groupBy("tag").agg({"tag": "count"}).orderBy("count(tag)",
>> ascending=False).show()
> 
> At the moment, tab completion isn't smart enough to know what the result of
> calling a function or method is, so it won't complete anything after the first
> groupBy there. This is something we hope to improve for IPython 6.
> 
> Thomas
> 
> -- 
> You received this message because you are subscribed to the Google Groups
> "Project Jupyter" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to jupyter+unsubscribe@googlegroups.com.
> To post to this group, send email to jupyter@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/jupyter/CAOvn4qiGbH_m-TqsSKA6ou-DenwJXJ9Z%2B
> xNXSQzV2u7Q5-6HhA%40mail.gmail.com
> <https://groups.google.com/d/msgid/jupyter/CAOvn4qiGbH_m-TqsSKA6ou-DenwJXJ9Z%2
> BxNXSQzV2u7Q5-6HhA%40mail.gmail.com?utm_medium=email&utm_source=footer> .
> For more options, visit https://groups.google.com/d/optout.



Mime
View raw message