spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Davidson (JIRA)" <>
Subject [jira] [Created] (SPARK-23878) unable to import col() or lit()
Date Fri, 06 Apr 2018 00:34:00 GMT
Andrew Davidson created SPARK-23878:

             Summary: unable to import col() or lit()
                 Key: SPARK-23878
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 2.3.0
         Environment: eclipse 4.7.3

pyDev 6.3.2

            Reporter: Andrew Davidson

I have some code I am moving from a jupyter notebook to separate python modules. My notebook
uses col() and list() and works fine

when I try to work with module files in my IDE I get the following errors. I am also not able
to run my unit tests.

{color:#FF0000}Description Resource Path Location Type{color}
{color:#FF0000}Unresolved import: lit /adt_pyDevProj/src/automatedDataTranslation
line 22 PyDev Problem{color}

{color:#FF0000}Description Resource Path Location Type{color}
{color:#FF0000}Unresolved import: col /adt_pyDevProj/src/automatedDataTranslation
line 21 PyDev Problem{color}

I suspect that when you run pyspark it is generating the col and lit functions?

I found a discription of the problem @ [] I
do not understand how to make this work in my IDE. I am not running pyspark just an editor

is there some sort of workaround or replacement for these missing functions?



This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message