spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saisai Shao <sai.sai.s...@gmail.com>
Subject Re: sbt publish-local fails with 2.0.0-SNAPSHOT
Date Mon, 01 Feb 2016 08:18:20 GMT
I think it is due to our recent changes to override the external resolvers
in sbt building profile, I just created a JIRA (
https://issues.apache.org/jira/browse/SPARK-13109) to track this.


On Mon, Feb 1, 2016 at 3:01 PM, Mike Hynes <91mbbh@gmail.com> wrote:

> Hi devs,
>
> I used to be able to do some local development from the upstream
> master branch and run the publish-local command in an sbt shell to
> publish the modified jars to the local ~/.ivy2 repository.
>
> I relied on this behaviour, since I could write other local packages
> that had my local 1.X.0-SNAPSHOT dependencies in the build.sbt file,
> such that I could run distributed tests from outside the spark source.
>
> However, having just pulled from the upstream master on
> 2.0.0-SNAPSHOT, I can *not* run publish-local with sbt, with the
> following error messages:
>
> [...]
> java.lang.RuntimeException: Undefined resolver 'local'
>         at scala.sys.package$.error(package.scala:27)
>         at sbt.IvyActions$$anonfun$publish$1.apply(IvyActions.scala:120)
>         at sbt.IvyActions$$anonfun$publish$1.apply(IvyActions.scala:117)
>         at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:155)
>         at sbt.IvySbt$Module$$anonfun$withModule$1.apply(Ivy.scala:155)
>         at sbt.IvySbt$$anonfun$withIvy$1.apply(Ivy.scala:132)
>         at sbt.IvySbt.sbt$IvySbt$$action$1(Ivy.scala:57)
>         at sbt.IvySbt$$anon$4.call(Ivy.scala:65)
>         at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:93)
>         at
> xsbt.boot.Locks$GlobalLock.xsbt$boot$Locks$GlobalLock$$withChannelRetries$1(Locks.scala:78)
>         at
> xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:97)
>         at xsbt.boot.Using$.withResource(Using.scala:10)
>         at xsbt.boot.Using$.apply(Using.scala:9)
>         at
> xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:58)
>         at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:48)
>         at xsbt.boot.Locks$.apply0(Locks.scala:31)
>         at xsbt.boot.Locks$.apply(Locks.scala:28)
>         at sbt.IvySbt.withDefaultLogger(Ivy.scala:65)
>         at sbt.IvySbt.withIvy(Ivy.scala:127)
>         at sbt.IvySbt.withIvy(Ivy.scala:124)
>         at sbt.IvySbt$Module.withModule(Ivy.scala:155)
>         at sbt.IvyActions$.publish(IvyActions.scala:117)
>         at sbt.Classpaths$$anonfun$publishTask$1.apply(Defaults.scala:1298)
>         at sbt.Classpaths$$anonfun$publishTask$1.apply(Defaults.scala:1297)
>         at scala.Function3$$anonfun$tupled$1.apply(Function3.scala:35)
>         at scala.Function3$$anonfun$tupled$1.apply(Function3.scala:34)
>         at scala.Function1$$anonfun$compose$1.apply(Function1.scala:47)
>         at
> sbt.$tilde$greater$$anonfun$$u2219$1.apply(TypeFunctions.scala:40)
>         at sbt.std.Transform$$anon$4.work(System.scala:63)
>         at
> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
>         at
> sbt.Execute$$anonfun$submit$1$$anonfun$apply$1.apply(Execute.scala:226)
>         at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:17)
>         at sbt.Execute.work(Execute.scala:235)
>         at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
>         at sbt.Execute$$anonfun$submit$1.apply(Execute.scala:226)
>         at
> sbt.ConcurrentRestrictions$$anon$4$$anonfun$1.apply(ConcurrentRestrictions.scala:159)
>         at sbt.CompletionService$$anon$2.call(CompletionService.scala:28)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:745)
> [...]
> [error] (spark/*:publishLocal) Undefined resolver 'local'
> [error] (hive/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-kafka-assembly/*:publishLocal) Undefined resolver
> 'local'
> [error] (unsafe/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-twitter/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-flume/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-kafka/*:publishLocal) Undefined resolver 'local'
> [error] (catalyst/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-akka/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-flume-sink/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-zeromq/*:publishLocal) Undefined resolver 'local'
> [error] (test-tags/*:publishLocal) Undefined resolver 'local'
> [error] (launcher/*:publishLocal) Undefined resolver 'local'
> [error] (network-shuffle/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-mqtt-assembly/*:publishLocal) Undefined resolver 'local'
> [error] (assembly/*:publishLocal) Undefined resolver 'local'
> [error] (docker-integration-tests/*:publishLocal) Undefined resolver
> 'local'
> [error] (tools/*:publishLocal) Undefined resolver 'local'
> [error] (sketch/*:publishLocal) Undefined resolver 'local'
> [error] (network-common/*:publishLocal) Undefined resolver 'local'
> [error] (repl/*:publishLocal) Undefined resolver 'local'
> [error] (core/*:publishLocal) Undefined resolver 'local'
> [error] (streaming/*:publishLocal) Undefined resolver 'local'
> [error] (graphx/*:publishLocal) Undefined resolver 'local'
> [error] (sql/compile:doc) Scaladoc generation failed
> [error] (streaming-mqtt/*:publishLocal) Undefined resolver 'local'
> [error] (mllib/*:publishLocal) Undefined resolver 'local'
> [error] (examples/*:publishLocal) Undefined resolver 'local'
> [error] (streaming-flume-assembly/*:publishLocal) Undefined resolver
> 'local'
>
> Could someone please tell me what has changed, and how I can publish
> modified 2.X.0-SNAPSHOT jars to the local .iv2 & .m2 caches?
>
> Thanks,
> Mike
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>

Mime
View raw message