spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyukjin Kwon (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-22302) Remove manual backports for subprocess.check_output and check_call
Date Sat, 21 Oct 2017 17:24:02 GMT

     [ https://issues.apache.org/jira/browse/SPARK-22302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hyukjin Kwon reassigned SPARK-22302:
------------------------------------

    Assignee: Hyukjin Kwon

> Remove manual backports for subprocess.check_output and check_call
> ------------------------------------------------------------------
>
>                 Key: SPARK-22302
>                 URL: https://issues.apache.org/jira/browse/SPARK-22302
>             Project: Spark
>          Issue Type: Improvement
>          Components: Project Infra
>    Affects Versions: 2.3.0
>            Reporter: Hyukjin Kwon
>            Assignee: Hyukjin Kwon
>            Priority: Trivial
>             Fix For: 2.3.0
>
>
> This JIRA is loosely related with SPARK-21573. Python 2.6 could be used in Jenkins given
the past cases and investigations up to my knowledge and it looks failing to execute some
other scripts.
> In this particular case, it was:
> {code}
> cd dev && python2.6
> {code}
> {code}
> >>> from sparktestsupport import shellutils
> >>> shellutils.subprocess_check_call("ls")
> Traceback (most recent call last):
>   File "<stdin>", line 1, in <module>
>   File "sparktestsupport/shellutils.py", line 46, in subprocess_check_call
>     retcode = call(*popenargs, **kwargs)
> NameError: global name 'call' is not defined
> {code}
> Please see https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3950/console
> Since we dropped the Python 2.6.x support, looks better we remove those workarounds and
print out explicit error messages in order to duplicate the efforts to find out the root causes
for such cases.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message