lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shawn Heisey <apa...@elyograg.org>
Subject Re: Filesystems supported by Solr
Date Sat, 03 Mar 2018 00:54:13 GMT
On 3/2/2018 2:30 PM, Ritesh Chaman wrote:
> I am trying to deploy solr on my ADLS subscription. can you tell me if that
> is tested and is compatible.

Walter says that this is storage related to Azure.

https://azure.microsoft.com/en-us/services/data-lake-store/

If this is what you are talking about, that page says they use HDFS
APIs.  Which means that you MIGHT be able to use it with the HDFS
support built into Solr.  You'd have to ask Microsoft what they can support.

But I can almost guarantee that unless you have plenty of memory in the
system for HDFS to cache that data, that it's going to be VERY slow,
just due to the amount of latency involved in accessing data over the
Internet.  Accessing the data after a reboot or a restart of the
particular service that caches the data is probably going to also be
extremely slow, even if you DO have plenty of memory for caching.

You'll see far better performance if you just install enough disk space
in your Solr servers to hold your index data, and install enough memory
that the OS can effectively cache that index data.

Thanks,
Shawn


Mime
View raw message