lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kevin Risden (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-9515) Update to Hadoop 3
Date Thu, 31 Jan 2019 23:14:00 GMT

    [ https://issues.apache.org/jira/browse/SOLR-9515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16757791#comment-16757791
] 

Kevin Risden commented on SOLR-9515:
------------------------------------

Well looks like I found something that is promising. I don't know why this would work on JDK8
though.

[https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/ForkJoinPool.html]
{code:java}
If a SecurityManager is present and no factory is specified, then the default pool uses
a factory supplying threads that have no Permissions enabled. The system class loader is
used to load these classes. Upon any error in establishing these settings, default parameters
are used. It is possible to disable or limit the use of threads in the common pool by setting
the parallelism property to zero, and/or using a factory that may return null. However doing
so may cause unjoined tasks to never be executed.
{code}
[https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/concurrent/ForkJoinPool.html]
{code:java}
If no thread factory is supplied via a system property, then the common pool uses a factory
that uses the system class loader as the thread context class loader. In addition, if a SecurityManager is
present, then the common pool uses a factory supplying threads that have no Permissions enabled.
Upon any error in establishing these settings, default parameters are used. It is possible
to disable or limit the use of threads in the common pool by setting the parallelism property
to zero, and/or using a factory that may return null. However doing so may cause unjoined
tasks to never be executed.{code}
From https://github.com/apache/hadoop/blob/branch-3.2/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java#L213

> Update to Hadoop 3
> ------------------
>
>                 Key: SOLR-9515
>                 URL: https://issues.apache.org/jira/browse/SOLR-9515
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>            Reporter: Mark Miller
>            Assignee: Kevin Risden
>            Priority: Blocker
>             Fix For: 8.0, master (9.0)
>
>         Attachments: SOLR-9515.patch, SOLR-9515.patch, SOLR-9515.patch, SOLR-9515.patch,
SOLR-9515.patch, SOLR-9515.patch
>
>          Time Spent: 4h 50m
>  Remaining Estimate: 0h
>
> Hadoop 3 is not out yet, but I'd like to iron out the upgrade to be prepared. I'll start
up a dev branch.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message