spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arush Kharbanda <ar...@sigmoidanalytics.com>
Subject Re: Building Spark behind a proxy
Date Thu, 29 Jan 2015 16:05:42 GMT
Does  the error change on build with and without the built options?
Did you try using maven? and doing the proxy settings there.

On Thu, Jan 29, 2015 at 9:17 PM, Soumya Simanta <soumya.simanta@gmail.com>
wrote:

> I'm trying to build Spark (v1.1.1 and v1.2.0) behind a proxy using
> ./sbt/sbt assembly and I get the following error. I've set the http and
> https proxy as well as the JAVA_OPTS. Any idea what am I missing ?
>
>
> [warn] one warning found
> org.apache.maven.model.building.ModelBuildingException: 1 problem was
> encountered while building the effective model for
> org.apache.spark:spark-parent:1.1.1
> [FATAL] Non-resolvable parent POM: Could not transfer artifact
> org.apache:apache:pom:14 from/to central (
> http://repo.maven.apache.org/maven2): Error transferring file: Connection
> refused from
> http://repo.maven.apache.org/maven2/org/apache/apache/14/apache-14.pom
> and 'parent.relativePath' points at wrong local POM @ line 21, column 11
>
>         at
> org.apache.maven.model.building.DefaultModelProblemCollector.newModelBuildingException(DefaultModelProblemCollector.java:195)
>         at
> org.apache.maven.model.building.DefaultModelBuilder.readParentExternally(DefaultModelBuilder.java:841)
>         at
> org.apache.maven.model.building.DefaultModelBuilder.readParent(DefaultModelBuilder.java:664)
>         at
> org.apache.maven.model.building.DefaultModelBuilder.build(DefaultModelBuilder.java:310)
>         at
> org.apache.maven.model.building.DefaultModelBuilder.build(DefaultModelBuilder.java:232)
>         at
> com.typesafe.sbt.pom.MvnPomResolver.loadEffectivePom(MavenPomResolver.scala:61)
>         at com.typesafe.sbt.pom.package$.loadEffectivePom(package.scala:41)
>         at
> com.typesafe.sbt.pom.MavenProjectHelper$.makeProjectTree(MavenProjectHelper.scala:128)
>         at
> com.typesafe.sbt.pom.MavenProjectHelper$.makeReactorProject(MavenProjectHelper.scala:49)
>         at
> com.typesafe.sbt.pom.PomBuild$class.projectDefinitions(PomBuild.scala:28)
>         at SparkBuild$.projectDefinitions(SparkBuild.scala:165)
>         at sbt.Load$.sbt$Load$$projectsFromBuild(Load.scala:458)
>         at sbt.Load$$anonfun$24.apply(Load.scala:415)
>         at sbt.Load$$anonfun$24.apply(Load.scala:415)
>         at scala.collection.immutable.Stream.flatMap(Stream.scala:442)
>         at sbt.Load$.loadUnit(Load.scala:415)
>         at sbt.Load$$anonfun$15$$anonfun$apply$11.apply(Load.scala:256)
>         at sbt.Load$$anonfun$15$$anonfun$apply$11.apply(Load.scala:256)
>         at
> sbt.BuildLoader$$anonfun$componentLoader$1$$anonfun$apply$4$$anonfun$apply$5$$anonfun$apply$6.apply(BuildLoader.scala:93)
>         at
> sbt.BuildLoader$$anonfun$componentLoader$1$$anonfun$apply$4$$anonfun$apply$5$$anonfun$apply$6.apply(BuildLoader.scala:92)
>         at sbt.BuildLoader.apply(BuildLoader.scala:143)
>         at sbt.Load$.loadAll(Load.scala:312)
>         at sbt.Load$.loadURI(Load.scala:264)
>         at sbt.Load$.load(Load.scala:260)
>         at sbt.Load$.load(Load.scala:251)
>         at sbt.Load$.apply(Load.scala:134)
>         at sbt.Load$.defaultLoad(Load.scala:37)
>         at sbt.BuiltinCommands$.doLoadProject(Main.scala:473)
>         at
> sbt.BuiltinCommands$$anonfun$loadProjectImpl$2.apply(Main.scala:467)
>         at
> sbt.BuiltinCommands$$anonfun$loadProjectImpl$2.apply(Main.scala:467)
>         at
> sbt.Command$$anonfun$applyEffect$1$$anonfun$apply$2.apply(Command.scala:60)
>         at
> sbt.Command$$anonfun$applyEffect$1$$anonfun$apply$2.apply(Command.scala:60)
>         at
> sbt.Command$$anonfun$applyEffect$2$$anonfun$apply$3.apply(Command.scala:62)
>         at
> sbt.Command$$anonfun$applyEffect$2$$anonfun$apply$3.apply(Command.scala:62)
>         at sbt.Command$.process(Command.scala:95)
>         at
> sbt.MainLoop$$anonfun$1$$anonfun$apply$1.apply(MainLoop.scala:100)
>         at
> sbt.MainLoop$$anonfun$1$$anonfun$apply$1.apply(MainLoop.scala:100)
>         at sbt.State$$anon$1.process(State.scala:179)
>         at sbt.MainLoop$$anonfun$1.apply(MainLoop.scala:100)
>         at sbt.MainLoop$$anonfun$1.apply(MainLoop.scala:100)
>         at sbt.ErrorHandling$.wideConvert(ErrorHandling.scala:18)
>         at sbt.MainLoop$.next(MainLoop.scala:100)
>         at sbt.MainLoop$.run(MainLoop.scala:93)
>         at sbt.MainLoop$$anonfun$runWithNewLog$1.apply(MainLoop.scala:71)
>         at sbt.MainLoop$$anonfun$runWithNewLog$1.apply(MainLoop.scala:66)
>         at sbt.Using.apply(Using.scala:25)
>         at sbt.MainLoop$.runWithNewLog(MainLoop.scala:66)
>         at sbt.MainLoop$.runAndClearLast(MainLoop.scala:49)
>         at sbt.MainLoop$.runLoggedLoop(MainLoop.scala:33)
>         at sbt.MainLoop$.runLogged(MainLoop.scala:25)
>         at sbt.StandardMain$.runManaged(Main.scala:57)
>         at sbt.xMain.run(Main.scala:29)
>         at xsbt.boot.Launch$$anonfun$run$1.apply(Launch.scala:109)
>         at xsbt.boot.Launch$.withContextLoader(Launch.scala:129)
>         at xsbt.boot.Launch$.run(Launch.scala:109)
>         at xsbt.boot.Launch$$anonfun$apply$1.apply(Launch.scala:36)
>         at xsbt.boot.Launch$.launch(Launch.scala:117)
>         at xsbt.boot.Launch$.apply(Launch.scala:19)
>         at xsbt.boot.Boot$.runImpl(Boot.scala:44)
>         at xsbt.boot.Boot$.main(Boot.scala:20)
>         at xsbt.boot.Boot.main(Boot.scala)
> [error] org.apache.maven.model.building.ModelBuildingException: 1 problem
> was encountered while building the effective model for
> org.apache.spark:spark-parent:1.1.1
> [error] [FATAL] Non-resolvable parent POM: Could not transfer artifact
> org.apache:apache:pom:14 from/to central (
> http://repo.maven.apache.org/maven2): Error transferring file: Connection
> refused from
> http://repo.maven.apache.org/maven2/org/apache/apache/14/apache-14.pom
> and 'parent.relativePath' points at wrong local POM @ line 21, column 11
> [error] Use 'last' for the full log.
> Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore?
>
>


-- 

[image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>

*Arush Kharbanda* || Technical Teamlead

arush@sigmoidanalytics.com || www.sigmoidanalytics.com

Mime
View raw message