spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Updated] (SPARK-4820) Spark build encounters "File name too long" on some encrypted filesystems
Date Fri, 13 Mar 2015 14:24:38 GMT


Sean Owen updated SPARK-4820:
    Priority: Minor  (was: Major)

Yes, it is not resolved. I am not sure it is worth modifying the build for this, as there
are few people develop Spark, fewer still who work on encrypted file systems, and those who
do can modify it this way. The issue is that it changes the output of the build just because
the source env was different, and I worry that this introduces important but subtle problems
in the resulting assembly.

> Spark build encounters "File name too long" on some encrypted filesystems
> -------------------------------------------------------------------------
>                 Key: SPARK-4820
>                 URL:
>             Project: Spark
>          Issue Type: Bug
>          Components: Build
>            Reporter: Patrick Wendell
>            Priority: Minor
> This was reported by Luchesar Cekov on github along with a proposed fix. The fix has
some potential downstream issues (it will modify the classnames) so until we understand better
how many users are affected we aren't going to merge it. However, I'd like to include the
issue and workaround here. If you encounter this issue please comment on the JIRA so we can
assess the frequency.
> The issue produces this error:
> {code}
> [error] == Expanded type of tree ==
> [error] 
> [error] ConstantType(value = Constant(Throwable))
> [error] 
> [error] uncaught exception during compilation:
> [error] File name too long
> [error] two errors found
> {code}
> The workaround is in maven under the compile options add: 
> {code}
> +              <arg>-Xmax-classfile-name</arg>
> +              <arg>128</arg>
> {code}
> In SBT add:
> {code}
> +    scalacOptions in Compile ++= Seq("-Xmax-classfile-name", "128"),
> {code}

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message