lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anuj B (JIRA)" <>
Subject [jira] [Commented] (SOLR-13397) Solr Syncing Script/Function
Date Fri, 12 Apr 2019 11:03:00 GMT


Anuj B commented on SOLR-13397:

Tried but getting errors -


{{<dataConfig> }}

{{<dataSource type="JdbcDataSource" driver="com.mysql.jdbc.Driver" batchSize="-1" autoReconnect="true"
socketTimeout="0" connectTimeout="0" url="jdbc:mysql://xxxx/livenews?zeroDateTimeBehavior=convertToNull"
user="admin" password="admin"/> }}

{{<document> <entity name="news" query="select * from news"> <field column="posting_id"
name="posting_id"/> <field column="date" name="date"/> <field column="name" name="name"/>
<field column="currency" name="currency"/> <field column="country" name="country"/>
<field column="expiry" name="expiry"/> </entity> </document> </dataConfig>


While doing full import getting the following message -
Last Update: 11:31:09
Requests: 1 , Fetched: 951,104 , Skipped: 0 , Processed: 951,104 
Started: 4 minutes ago 

However the overview shows
Last Modified: 2 minutes ago 
Num Docs: 941601
Max Doc: 941601

Not all records are getting indexed. Logging shows the following message -

{{WARN false SimplePropertiesWriter Unable to read: ERROR false EntityProcessorBase
getNext() failed for query 'select * from news':org.apache.solr.handler.dataimport.DataImportHandlerException:
java.sql.SQLException: Operation not allowed after ResultSet closed }}

{{ERROR false DocBuilder Exception while processing: news document : SolrInputDocument(fields:
[]):org.apache.solr.handler.dataimport.DataImportHandlerException: java.sql.SQLException:
Operation not allowed after ResultSet closed }}

{{ERROR false DataImporter Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException:
org.apache.solr.handler.dataimport.DataImportHandlerException: java.sql.SQLException: Operation
not allowed after ResultSet closed }}

{{ERROR false CommitTracker auto commit error...:org.apache.solr.common.SolrException: Error
opening new searcher}}

> Solr Syncing Script/Function
> ----------------------------
>                 Key: SOLR-13397
>                 URL:
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>            Reporter: Anuj B
>            Priority: Major
> A syncing script/function would be a nice addon feature. It should automatically check
the MySql database and index the contents according to the changes/additions/deletions made
in the main MySql database

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message