lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anuj B (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SOLR-13397) Solr Syncing Script/Function
Date Fri, 12 Apr 2019 11:03:00 GMT

    [ https://issues.apache.org/jira/browse/SOLR-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16816171#comment-16816171
] 

Anuj B commented on SOLR-13397:
-------------------------------

Tried but getting errors -

data-config.xml

{{<dataConfig> }}

{{<dataSource type="JdbcDataSource" driver="com.mysql.jdbc.Driver" batchSize="-1" autoReconnect="true"
socketTimeout="0" connectTimeout="0" url="jdbc:mysql://xxxx/livenews?zeroDateTimeBehavior=convertToNull"
user="admin" password="admin"/> }}

{{<document> <entity name="news" query="select * from news"> <field column="posting_id"
name="posting_id"/> <field column="date" name="date"/> <field column="name" name="name"/>
<field column="currency" name="currency"/> <field column="country" name="country"/>
<field column="expiry" name="expiry"/> </entity> </document> </dataConfig>
}}

 

While doing full import getting the following message -
Last Update: 11:31:09
Requests: 1 , Fetched: 951,104 , Skipped: 0 , Processed: 951,104 
Started: 4 minutes ago 



However the overview shows
Last Modified: 2 minutes ago 
Num Docs: 941601
Max Doc: 941601



Not all records are getting indexed. Logging shows the following message -

{{WARN false SimplePropertiesWriter Unable to read: dataimport.properties ERROR false EntityProcessorBase
getNext() failed for query 'select * from news':org.apache.solr.handler.dataimport.DataImportHandlerException:
java.sql.SQLException: Operation not allowed after ResultSet closed }}

{{ERROR false DocBuilder Exception while processing: news document : SolrInputDocument(fields:
[]):org.apache.solr.handler.dataimport.DataImportHandlerException: java.sql.SQLException:
Operation not allowed after ResultSet closed }}

{{ERROR false DataImporter Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException:
org.apache.solr.handler.dataimport.DataImportHandlerException: java.sql.SQLException: Operation
not allowed after ResultSet closed }}

{{ERROR false CommitTracker auto commit error...:org.apache.solr.common.SolrException: Error
opening new searcher}}

> Solr Syncing Script/Function
> ----------------------------
>
>                 Key: SOLR-13397
>                 URL: https://issues.apache.org/jira/browse/SOLR-13397
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>            Reporter: Anuj B
>            Priority: Major
>
> A syncing script/function would be a nice addon feature. It should automatically check
the MySql database and index the contents according to the changes/additions/deletions made
in the main MySql database



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Mime
View raw message