maven-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eva Müller (Jira) <j...@apache.org>
Subject [jira] [Commented] (MRESOLVER-114) ArtifactNotFoundExceptions when building in parallel
Date Fri, 19 Jun 2020 19:31:00 GMT

    [ https://issues.apache.org/jira/browse/MRESOLVER-114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140768#comment-17140768
] 

Eva Müller commented on MRESOLVER-114:
--------------------------------------

Thanks [~slachiewicz] for this hint. [~michael-o] also mentioned this [here|https://issues.apache.org/jira/browse/MRESOLVER-114?focusedCommentId=17127769&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17127769].

\\

----

\\

FYI [~michael-o] 
Although the last release of the {{takari-local-repository}} extension is stated as [0.11.2
at GitHub|https://github.com/takari/takari-local-repository/releases] (this was the version
 we used)
there is a [new release 0.11.3 since Nov 2019|https://mvnrepository.com/artifact/io.takari.aether/takari-local-repository].
I stumbled upon this by accident. This release resolves [issue #5 (apparent race during maven
multi-threaded build )|https://github.com/takari/takari-local-repository/issues/5].

I currently re-testing 0.11.3 because I lost my evidence that the failure still occurs.

\\


> ArtifactNotFoundExceptions when building in parallel
> ----------------------------------------------------
>
>                 Key: MRESOLVER-114
>                 URL: https://issues.apache.org/jira/browse/MRESOLVER-114
>             Project: Maven Resolver
>          Issue Type: Bug
>          Components: resolver
>    Affects Versions: 1.4.2
>            Reporter: Rainer Reich
>            Priority: Major
>         Attachments: BasicRepositoryConnector.java, DefaultArtifactResolver.java, maven-debug-log.txt,
mvn-build-120-sorted.txt, mvn-build-120.log, mvn-build-134-sorted.txt, mvn-build-134.log,
mvn-build-144-sorted.txt, mvn-build-144.log
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> We have a multi-module project with quite many modules and many dependencies and observe
pretty random {{ArtifactNotFoundExceptions}} when building in parallel with an empty local
repository.
> The "funny" thing is that Maven did in fact download the jar that it complained about
not finding.
> In this example Maven said it could not find {{edu.tum.cs:cup-runtime:jar:11a}} (see
stacktrace below)
>  But it also said: {{Downloaded from central-mirror: [https://mirror.xy.com/repository/maven-all-mirror/edu/tum/cs/cup-runtime/11a/cup-runtime-11a.jar]}}.
> When looking into the local repository after the failed build we found the cup-runtime.jar
in the correct place with the correct checksum.
> We tried the following to "fix" the problem:
>  * build with and without the takari extensions ({{takari-local-repository}} & {{takari-smart-builder}})
using {{--builder smart}}
>  * also build with {{io.takari.aether:aether-connector-okhttp}} extension
>  * only execute goal package instead of install
>  * build with these properties: {{-Daether.connector.basic.threads=1 -Daether.connector.resumeDownloads=false}}
> But nothing helped.
> Unfortunately it seems to be a race condition and we cannot reproduce it consistently
but it happens in about 1 out of 5 builds.
> {code:java}
> ...
> [2019-11-18T16:46:29.370Z] [INFO] Downloaded from central-mirror: https://mirror.xy.com/repository/maven-all-mirror/edu/tum/cs/cup-runtime/11a/cup-runtime-11a.jar
(13 kB at 738 kB/s)
> ...
> [2019-11-18T16:46:30.894Z] [ERROR] Failed to execute goal on project xy: Could not resolve
dependencies for project xy: The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a,
org.checkerframework:checker-qual:jar:2.5.7, org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0:
Could not find artifact edu.tum.cs:cup-runtime:jar:11a -> [Help 1]
> [2019-11-18T16:46:30.894Z] org.apache.maven.lifecycle.LifecycleExecutionException: Failed
to execute goal on project xy: Could not resolve dependencies for project xy: The following
artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7,
org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies
(LifecycleDependencyResolver.java:269)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies
(LifecycleDependencyResolver.java:147)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved
(MojoExecutor.java:248)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:156)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:148)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject
(SmartBuilderImpl.java:205)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run
(SmartBuilderImpl.java:77)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call
(Executors.java:515)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:628)
> [2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
> [2019-11-18T16:46:30.894Z] Caused by: org.apache.maven.project.DependencyResolutionException:
Could not resolve dependencies for project xy: The following artifacts could not be resolved:
edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7, org.ow2.asm:asm:jar:7.2,
cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve
(DefaultProjectDependenciesResolver.java:209)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies
(LifecycleDependencyResolver.java:243)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies
(LifecycleDependencyResolver.java:147)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved
(MojoExecutor.java:248)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:156)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:148)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject
(SmartBuilderImpl.java:205)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run
(SmartBuilderImpl.java:77)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call
(Executors.java:515)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:628)
> [2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
> [2019-11-18T16:46:30.894Z] Caused by: org.eclipse.aether.resolution.DependencyResolutionException:
The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7,
org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
> [2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies
(DefaultRepositorySystem.java:357)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve
(DefaultProjectDependenciesResolver.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies
(LifecycleDependencyResolver.java:243)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies
(LifecycleDependencyResolver.java:147)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved
(MojoExecutor.java:248)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:156)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:148)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject
(SmartBuilderImpl.java:205)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run
(SmartBuilderImpl.java:77)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call
(Executors.java:515)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:628)
> [2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
> [2019-11-18T16:46:30.894Z] Caused by: org.eclipse.aether.resolution.ArtifactResolutionException:
The following artifacts could not be resolved: edu.tum.cs:cup-runtime:jar:11a, org.checkerframework:checker-qual:jar:2.5.7,
org.ow2.asm:asm:jar:7.2, cglib:cglib:jar:3.3.0: Could not find artifact edu.tum.cs:cup-runtime:jar:11a
> [2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve
(DefaultArtifactResolver.java:424)
> [2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts
(DefaultArtifactResolver.java:229)
> [2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies
(DefaultRepositorySystem.java:340)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve
(DefaultProjectDependenciesResolver.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies
(LifecycleDependencyResolver.java:243)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies
(LifecycleDependencyResolver.java:147)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved
(MojoExecutor.java:248)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:156)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:148)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject
(SmartBuilderImpl.java:205)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run
(SmartBuilderImpl.java:77)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call
(Executors.java:515)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:628)
> [2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
> [2019-11-18T16:46:30.894Z] Caused by: org.eclipse.aether.transfer.ArtifactNotFoundException:
Could not find artifact edu.tum.cs:cup-runtime:jar:11a
> [2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolve
(DefaultArtifactResolver.java:414)
> [2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultArtifactResolver.resolveArtifacts
(DefaultArtifactResolver.java:229)
> [2019-11-18T16:46:30.894Z]     at org.eclipse.aether.internal.impl.DefaultRepositorySystem.resolveDependencies
(DefaultRepositorySystem.java:340)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.project.DefaultProjectDependenciesResolver.resolve
(DefaultProjectDependenciesResolver.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.getDependencies
(LifecycleDependencyResolver.java:243)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleDependencyResolver.resolveProjectDependencies
(LifecycleDependencyResolver.java:147)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.ensureDependenciesAreResolved
(MojoExecutor.java:248)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:202)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:156)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.MojoExecutor.execute
(MojoExecutor.java:148)
> [2019-11-18T16:46:30.894Z]     at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject
(LifecycleModuleBuilder.java:117)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl.buildProject
(SmartBuilderImpl.java:205)
> [2019-11-18T16:46:30.894Z]     at io.takari.maven.builder.smart.SmartBuilderImpl$ProjectBuildTask.run
(SmartBuilderImpl.java:77)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.Executors$RunnableAdapter.call
(Executors.java:515)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.FutureTask.run (FutureTask.java:264)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1128)
> [2019-11-18T16:46:30.894Z]     at java.util.concurrent.ThreadPoolExecutor$Worker.run
(ThreadPoolExecutor.java:628)
> [2019-11-18T16:46:30.894Z]     at java.lang.Thread.run (Thread.java:834)
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message