From commits-return-21633-apmail-jackrabbit-commits-archive=jackrabbit.apache.org@jackrabbit.apache.org Wed Jul 10 10:18:20 2019 Return-Path: X-Original-To: apmail-jackrabbit-commits-archive@www.apache.org Delivered-To: apmail-jackrabbit-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by minotaur.apache.org (Postfix) with SMTP id 73F9E1919C for ; Wed, 10 Jul 2019 10:18:19 +0000 (UTC) Received: (qmail 66904 invoked by uid 500); 10 Jul 2019 10:18:18 -0000 Delivered-To: apmail-jackrabbit-commits-archive@jackrabbit.apache.org Received: (qmail 66860 invoked by uid 500); 10 Jul 2019 10:18:18 -0000 Mailing-List: contact commits-help@jackrabbit.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@jackrabbit.apache.org Delivered-To: mailing list commits@jackrabbit.apache.org Received: (qmail 66791 invoked by uid 99); 10 Jul 2019 10:18:18 -0000 Received: from Unknown (HELO svn01-us-west.apache.org) (209.188.14.144) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 10 Jul 2019 10:18:18 +0000 Received: from svn01-us-west.apache.org (localhost [127.0.0.1]) by svn01-us-west.apache.org (ASF Mail Server at svn01-us-west.apache.org) with ESMTP id D5CE33A3861 for ; Wed, 10 Jul 2019 10:18:16 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1862864 [3/9] - in /jackrabbit/site/live/oak/docs: ./ architecture/ coldstandby/ features/ nodestore/ nodestore/document/ nodestore/segment/ oak-mongo-js/ oak_api/ plugins/ query/ security/ security/accesscontrol/ security/authentication/ ... Date: Wed, 10 Jul 2019 10:18:15 -0000 To: commits@jackrabbit.apache.org From: reschke@apache.org X-Mailer: svnmailer-1.0.9 Message-Id: <20190710101816.D5CE33A3861@svn01-us-west.apache.org> Modified: jackrabbit/site/live/oak/docs/nodestore/document/mongo-document-store.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/document/mongo-document-store.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/document/mongo-document-store.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/document/mongo-document-store.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – MongoDB DocumentStore @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -198,7 +207,15 @@
  • Solr Index
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/document/node-bundling.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/document/node-bundling.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/document/node-bundling.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/document/node-bundling.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Bundling Nodes @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/document/rdb-document-store.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/document/rdb-document-store.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/document/rdb-document-store.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/document/rdb-document-store.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – RDB DocumentStore @@ -151,9 +151,9 @@
    @@ -540,6 +540,53 @@ Id State Started LeaseEnd Le

    Note that in Oak versions prior to June 2019, oak-run also does not contain the artefacts tomcat-jdbc and tomcat-juli, which thus need to be added to the classpath as well (see OAK-8341 for details).

    +
    +

    Reading Log Files

    +

    There are certain log messages to look out for when investigating problems, and also some that may cause unneeded confusion.

    +

    See below.

    +
    +

    Startup Message

    +

    Such as:

    + +
    +
    +
    16:26:28.172 INFO  [main] RDBDocumentStore.java:1065        RDBDocumentStore (SNAPSHOT) instantiated for database PostgreSQL 10.6 (10.6), using driver: PostgreSQL JDBC Driver 42.2.5 (42.2), connecting to: jdbc:postgresql:oak, properties: {datcollate=C, pg_encoding_to_char(encoding)=UTF8}, transaction isolation level: TRANSACTION_READ_COMMITTED (2), .nodes: id varchar(512), modified int8, hasbinary int2, deletedonce int2, modcount int8, cmodcount int8, dsize int8, version int2, sdtype int2, sdmaxrevtime int8, data varchar(16384), bdata bytea(2147483647) /* {bytea=-2, int2=5, int8=-5, varchar=12} */ /* index nodes_mod on public.nodes (modified ASC) other (#0, p1), unique index nodes_pkey on public.nodes (id ASC) other (#0, p1), index nodes_sdm on public.nodes (sdmaxrevtime ASC) other (#0, p1), index nodes_sdt on public.nodes (sdtype ASC) other (#0, p1), index nodes_vsn on public.nodes (version ASC) other (#0, p1) */
+
    + +

    The information dumped here is essential for diagnosing issues and should be included in all bug reports. It includes:

    +
      + +
    • Oak’s version number
      • +
    • Database type and version
      • +
    • JDBC driver and version
      • +
    • JDBC “URL”
      • +
    • certain DB-specific properties
      • +
    • JDBC transaction isolation level
      • +
    • schema for “NODES” table (other tables are not reported; they ought to be the same)
      • +
    • information on database indices
      • +
    +
    +

    “Long Running Queries”

    +

    RDBDocumentStore will log an INFO message when a query takes longer than 10s, which frequently indicates a configuration problem.

    + +
    +
    +
    INFO  ... org.apache.jackrabbit.oak.plugins.document.rdb.RDBDocumentStoreJDBC - Long running query on NODES with 100 hits (limited to 100), elapsed time 11361ms (configured QUERYTIMELIMIT 10000), params minid 'null' maxid 'null' excludeKeyPatterns [] conditions [_modified >= 1554909530] limit 100. Result range: '0:/'...'12:/...'. Read 26126 chars from DATA and 0 bytes from BDATA. Check calling method.
+java.lang.Exception: call stack
+
    + +

    The call stack is dumped to identify the piece of code that executed the query. It is important to understand that this is not an error, it is just logged for diagnostic purposes.

    +
    +

    Tomcat JDBC Pool Interceptor Messages

    +

    When using the Tomcat JDBC connection pool, by default “slow” and “failed” queries will be logged on WARN level. The latter category is a bit problematic, as what Tomcat thinks is a failure might be completely normal and expected behavior. For instance:

    + +
    +
    +
    WARN [...] org.apache.tomcat.jdbc.pool.interceptor.SlowQueryReport Failed Query Report SQL=update NODES set MODIFIED = case when ? > MODIFIED then ? else MODIFIED end, HASBINARY = ?, DELETEDONCE = ?, MODCOUNT = ?, CMODCOUNT = ?, DSIZE = DSIZE + ?, VERSION = 2, DATA = CASE WHEN LEN(DATA) < ? THEN (DATA + CAST(? AS nvarchar(4000))) ELSE (DATA + CAST(DATA AS nvarchar(max))) END where ID = ? and MODCOUNT = ?; time=1 ms;
+
    + +

    This just indicates that an update operation that was made conditional did not happen because the condition was not met.

    +

    Another example are insert operations, which are done “optimistically”, and will automatically be retried as updates upon failure.

    Modified: jackrabbit/site/live/oak/docs/nodestore/document/secondary-store.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/document/secondary-store.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/document/secondary-store.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/document/secondary-store.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Secondary NodeStore @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/document/upgrade.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/document/upgrade.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/document/upgrade.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/document/upgrade.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – DocumentNodeStore upgrade instructions @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/documentmk.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/documentmk.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/documentmk.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/documentmk.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Oak Document Storage @@ -151,9 +151,9 @@
    Modified: jackrabbit/site/live/oak/docs/nodestore/overview.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/overview.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/overview.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/overview.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Node Storage @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -170,6 +179,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/persistent-cache.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/persistent-cache.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/persistent-cache.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/persistent-cache.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Persistent Cache @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/segment/changes.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/segment/changes.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/segment/changes.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/segment/changes.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Changes in the data format @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/segment/classes.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/segment/classes.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/segment/classes.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/segment/classes.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Design of Oak Segment Tar @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/segment/onrc-memoirs.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/segment/onrc-memoirs.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/segment/onrc-memoirs.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/segment/onrc-memoirs.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Memoirs in Garbage Collection @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -197,7 +206,15 @@
  • Solr Index
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/segment/overview.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/segment/overview.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/segment/overview.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/segment/overview.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Oak Segment Tar @@ -151,9 +151,9 @@
    Modified: jackrabbit/site/live/oak/docs/nodestore/segment/records.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/segment/records.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/segment/records.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/segment/records.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Segments and records @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/segment/tar.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/segment/tar.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/segment/tar.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/segment/tar.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Structure of TAR files @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/nodestore/segmentmk.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/nodestore/segmentmk.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/nodestore/segmentmk.html (original) +++ jackrabbit/site/live/oak/docs/nodestore/segmentmk.html Wed Jul 10 10:18:13 2019 @@ -1,13 +1,13 @@ - + Jackrabbit Oak – Segment Storage Design Overview @@ -51,7 +51,7 @@
  • Main APIs @@ -86,7 +86,16 @@
  • Solr Index
    • -
  • Security
    • +
  • +Security + +
  • Atomic Counter
  • Observation
    • @@ -142,9 +151,9 @@
    @@ -160,7 +169,7 @@
  • Overview
  • The Node State Model
  • Main APIs
    • -
  • JCR API
    • +
  • JCR API
  • Jackrabbit API
  • Oak API
  • Features and Plugins
    • @@ -169,6 +178,7 @@
  • Document NodeStore
    • -
  • Security
    • +
  • Security + +
  • Atomic Counter
  • Observation
  • Using Oak
    • Modified: jackrabbit/site/live/oak/docs/oak-mongo-js/index.html URL: http://svn.apache.org/viewvc/jackrabbit/site/live/oak/docs/oak-mongo-js/index.html?rev=1862864&r1=1862863&r2=1862864&view=diff ============================================================================== --- jackrabbit/site/live/oak/docs/oak-mongo-js/index.html (original) +++ jackrabbit/site/live/oak/docs/oak-mongo-js/index.html Wed Jul 10 10:18:13 2019 @@ -56,7 +56,7 @@
    - Documentation generated by JSDoc 3.3.2 on Wed Jan 09 2019 12:16:51 GMT+0100 (CET) + Documentation generated by JSDoc 3.3.2 on Wed Jul 10 2019 10:13:08 GMT-0000 (GMT)