lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ishan Chattopadhyaya (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SOLR-5944) Support updates of numeric DocValues
Date Mon, 23 Jan 2017 07:14:26 GMT

    [ https://issues.apache.org/jira/browse/SOLR-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833767#comment-15833767
] 

Ishan Chattopadhyaya edited comment on SOLR-5944 at 1/23/17 7:13 AM:
---------------------------------------------------------------------

{code}
In this version of the script [0], the exact same 20K documents are added, and the script
still does 
50 iterations of 5K updates – but this time only to the stored+indexed long field...
{code}

Hoss' results, as of c21d8a005387eae4d0f0adde4de7e4e465fb73c8, on his laptop:
||Branch||Adds||stored+indexed Updates||
|master|49|521|
|5944|50|527|

My results:
||Branch||Adds||stored+indexed Updates||
|master|37|603|
|5944|38|637|

-Seems like a 1% (Hoss) and 5% (my) slowdown in the regular non-dv updates from master to
5944. Will try to dig deeper to see if this slowdown can be avoided/reduced.-

----
Edit: I just did 12 runs (3 on 5944, then 3 on master, then 3 on 5944, then 3 on master).
Here are the results of the 12 runs, and average per branch:

||Branch||1||2||3||4||5||6||7||8||9||10||11||12||Avg||
|master| | | |652|671|676| | | |701|667|628||666||
|5944|656|661|676| | | |656|652|664| | | ||661||

I think these differences are just due to statistical noise, and there is no significant speedup/slowdown
for the non-dv updates.

[0] - https://gist.github.com/chatman/c085af9d1ea9d9e2c56d037e0c6ab119


was (Author: ichattopadhyaya):
{code}
In this version of the script [0], the exact same 20K documents are added, and the script
still does 
50 iterations of 5K updates – but this time only to the stored+indexed long field...
{code}

Hoss' results, as of c21d8a005387eae4d0f0adde4de7e4e465fb73c8, on his laptop:
||Branch||Adds||stored+indexed Updates||
|master|49|521|
|5944|50|527|

My results:
||Branch||Adds||stored+indexed Updates||
|master|37|603|
|5944|38|637|

-Seems like a 1% (Hoss) and 5% (my) slowdown in the regular non-dv updates from master to
5944. Will try to dig deeper to see if this slowdown can be avoided/reduced.-

----
Edit: I just did 12 runs (3 on 5944, then 3 on master, then 3 on 5944, then 3 on master).
Here are the results of the 12 runs, and average per branch:

||Branch||1|2|3|4|5|6|7|8|9|10|11|12|Avg||
|master| | | |652|671|676| | | |701|667|628|666|
|5944|656|661|676| | | |656|652|664| | | |661|

I think these differences are just due to statistical noise, and there is no significant speedup/slowdown
for the non-dv updates.

[0] - https://gist.github.com/chatman/c085af9d1ea9d9e2c56d037e0c6ab119

> Support updates of numeric DocValues
> ------------------------------------
>
>                 Key: SOLR-5944
>                 URL: https://issues.apache.org/jira/browse/SOLR-5944
>             Project: Solr
>          Issue Type: New Feature
>            Reporter: Ishan Chattopadhyaya
>            Assignee: Shalin Shekhar Mangar
>         Attachments: defensive-checks.log.gz, demo-why-dynamic-fields-cannot-be-inplace-updated-first-time.patch,
DUP.patch, hoss.62D328FA1DEA57FD.fail2.txt, hoss.62D328FA1DEA57FD.fail3.txt, hoss.62D328FA1DEA57FD.fail.txt,
hoss.D768DD9443A98DC.fail.txt, hoss.D768DD9443A98DC.pass.txt, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch, SOLR-5944.patch,
SOLR-5944.patch, TestStressInPlaceUpdates.eb044ac71.beast-167-failure.stdout.txt, TestStressInPlaceUpdates.eb044ac71.beast-587-failure.stdout.txt,
TestStressInPlaceUpdates.eb044ac71.failures.tar.gz
>
>
> LUCENE-5189 introduced support for updates to numeric docvalues. It would be really nice
to have Solr support this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message