lucene-solr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Allison, Timothy B." <talli...@mitre.org>
Subject Testing an ingest framework that uses Apache Tika
Date Thu, 16 Feb 2017 13:17:08 GMT
All,

I finally got around to documenting Apache Tika's MockParser[1].  As of Tika 1.15 (unreleased),
add tika-core-tests.jar to your class path, and you can simulate:

1. Regular catchable exceptions
2. OOMs
3. Permanent hangs

This will allow you to determine if your ingest framework is robust against these issues.

As always, we fix Tika when we can, but if history is any indicator, you'll want to make sure
your ingest code can handle these issues if you are handling millions/billions of files from
the wild.

Cheers,

            Tim


[1] https://wiki.apache.org/tika/MockParser

Mime
View raw message