drill-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bridg...@apache.org
Subject [drill-site] branch asf-site updated: updates for maprdb format plugin options, rn update
Date Fri, 24 May 2019 22:57:40 GMT
This is an automated email from the ASF dual-hosted git repository.

bridgetb pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/drill-site.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new f0475b4  updates for maprdb format plugin options, rn update
f0475b4 is described below

commit f0475b4ec016f0671bbcc30735278c45515db753
Author: Bridget Bevens <bbevens@maprtech.com>
AuthorDate: Fri May 24 15:57:26 2019 -0700

    updates for maprdb format plugin options, rn update
---
 docs/apache-drill-1-16-0-release-notes/index.html |  2 +
 docs/data-type-conversion/index.html              | 45 ++++++++++++++++++++---
 docs/mapr-db-format/index.html                    |  6 ++-
 docs/refresh-table-metadata/index.html            |  7 +++-
 docs/running-drill-on-docker/index.html           | 14 +++----
 feed.xml                                          |  4 +-
 6 files changed, 60 insertions(+), 18 deletions(-)

diff --git a/docs/apache-drill-1-16-0-release-notes/index.html b/docs/apache-drill-1-16-0-release-notes/index.html
index cc8fe3e..01a5af3 100644
--- a/docs/apache-drill-1-16-0-release-notes/index.html
+++ b/docs/apache-drill-1-16-0-release-notes/index.html
@@ -1342,6 +1342,8 @@
 <li>Ability to query Hive views, like querying Hive tables in a hive schema, for example
<code>SELECT * FROM hive.</code>hive_view`; (<a href="https://issues.apache.org/jira/browse/DRILL-540">DRILL-540</a>)</li>
 <li><a href="/docs/configuring-the-drill-shell/">Upgrade to SQLLine 1.7</a>
changes the default prompt to <code>apache drill (schema_name)&gt;</code>
or you can define a custom prompt using the command <code>!set prompt &lt;new-prompt&gt;</code>.
(<a href="https://issues.apache.org/jira/browse/DRILL-6989">DRILL-6989</a>) </li>
 <li>Calcite updated to version 1.18.0 (<a href="https://issues.apache.org/jira/browse/DRILL-6862">DRILL-6862</a>)<br></li>
+<li>A new maprdb format plugin option, <code>readTimestampWithZoneOffset</code>,
converts timestamp values from UTC to local time zone when values are read from MapR Database.
This option is disabled by default. (<a href="https://issues.apache.org/jira/browse/DRILL-6969">DRILL-6969</a>)<br></li>
+<li>A new Drill configuration option, <code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>,
enables Drill to read timestamp values with a timezone offset when using the hive plugin with
the Drill native MaprDB JSON reader enabled. This option is disabled by default. (<a href="https://issues.apache.org/jira/browse/DRILL-6969">DRILL-6969</a>)<br></li>
 <li>Several Drill Web UI improvements, including:
 
 <ul>
diff --git a/docs/data-type-conversion/index.html b/docs/data-type-conversion/index.html
index d7c317b..b544ffc 100644
--- a/docs/data-type-conversion/index.html
+++ b/docs/data-type-conversion/index.html
@@ -1320,7 +1320,7 @@
 
     </div>
 
-     Feb 19, 2019
+     May 24, 2019
 
     <link href="/css/docpage.css" rel="stylesheet" type="text/css">
 
@@ -1335,7 +1335,7 @@
 <li><a href="/docs/data-type-conversion/#other-data-type-conversions">Other Data
Type Conversions</a><br></li>
 </ul>
 
-<p><strong>Note:</strong> Starting in Drill 1.15, all cast and data type
conversion functions return null for an empty string (&#39;&#39;) when the <code>drill.exec.functions.cast_empty_string_to_null</code>
option is enabled, for example:    </p>
+<p>Starting in Drill 1.15, all cast and data type conversion functions return null
for an empty string (&#39;&#39;) when the <code>drill.exec.functions.cast_empty_string_to_null</code>
option is enabled, for example:    </p>
 <div class="highlight"><pre><code class="language-text" data-lang="text">SELECT
CAST(&#39;&#39; AS DATE), TO_TIMESTAMP(&#39;&#39;, &#39;yyyy-MM-dd HH:mm:ss&#39;)
FROM (VALUES(2));
 +---------+---------+
 | EXPR$0  | EXPR$1  |
@@ -2348,11 +2348,46 @@ FROM (VALUES(1));
 +------------------------+---------+
 | 2015-03-30 20:49:00.0  | UTC     |
 +------------------------+---------+
-1 row selected (0.148 seconds)
+1 row selected (0.148 seconds)  
 </code></pre></div>
+<h2 id="enabling-time-zone-offset">Enabling Time Zone Offset</h2>
+
+<p>Starting in Drill 1.16, the <code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>
option enables Drill to read timestamp values with a timezone offset when using the hive plugin
with the Drill native MaprDB JSON reader enabled through the  <code>store.hive.maprdb_json.optimize_scan_with_native_reader
option</code>. The <code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>
option is disabled (set to &#39;false&#39;) by default. You can enable this op [...]
+
+<p><strong>Important</strong><br>
+Internally, Drill stores timestamp values in UTC format, for example 2018-01-01T20:12:12.123Z.
When you enable the timezone offset option, select on a table returns different timestamp
values. If you filter on timestamp values when this option is enabled, you must include the
new timestamp value in the filter condition. </p>
+
+<p>For example, look at the timestamp values when the <code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>
option is disabled (set to &#39;false&#39;):   </p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">select
* from dfs.`/tmp/timestamp`;
+-------------------------------------------------------
+_id datestring  datetimestamp
+-------------------------------------------------------
+1   2018-01-01 12:12:12.123 2018-01-01 20:12:12.123
+2   9999-12-31 23:59:59.999 10000-01-01 07:59:59.999
+-------------------------------------------------------  
+</code></pre></div>
+<p>When the option is enabled (set to &#39;true&#39;), you can see the difference
in the timestamp values returned:  </p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">select
* from dfs.`/tmp/timestamp`;
+------------------------------------------------------
+_id datestring  datetimestamp
+------------------------------------------------------
+1   2018-01-01 12:12:12.123 2018-01-01 12:12:12.123
+2   9999-12-31 23:59:59.999 9999-12-31 23:59:59.999
+------------------------------------------------------  
+</code></pre></div>
+<p>When the option is enabled, queries that filter on timestamp values must include
the new timestamp value in the filter condition, as shown:  </p>
+<div class="highlight"><pre><code class="language-text" data-lang="text">select
* from dfs.`/tmp/timestamp` where datetimestamp=timestamp &#39;2018-01-01 12:12:12.123&#39;;
+------------------------------------------------------
+_id datestring  datetimestamp
+------------------------------------------------------
+1   2018-01-01 12:12:12.123 2018-01-01 12:12:12.123
+------------------------------------------------------  
+</code></pre></div>
+<p>Notice that the WHERE clause uses the <code>2018-01-01 12:12:12.123</code>
format versus the <code>2018-01-01 20:12:12.123</code> format.</p>
+
 <h2 id="time-zone-limitation">Time Zone Limitation</h2>
 
-<p>Currently Drill does not support conversion of a date, time, or timestamp from one
time zone to another. Queries of data associated with a time zone can return inconsistent
results or an error. For more information, see the <a href="http://www.openkb.info/2015/05/understanding-drills-timestamp-and.html#.VUzhotpVhHw">&quot;Understanding
Drill&#39;s Timestamp and Timezone&quot;</a> blog. The Drill time zone is based
on the operating system time zone unless you override it. To work aroun [...]
+<p>Drill does not support conversion of a date, time, or timestamp from one time zone
to another. Queries of data associated with a time zone can return inconsistent results or
an error. For more information, see the <a href="http://www.openkb.info/2015/05/understanding-drills-timestamp-and.html#.VUzhotpVhHw">&quot;Understanding
Drill&#39;s Timestamp and Timezone&quot;</a> blog. The Drill time zone is based
on the operating system time zone unless you override it. To work around the limi [...]
 
 <ol>
 <li><p>Take a look at the Drill time zone configuration by running the TIMEOFDAY
function or by querying the system.options table. This TIMEOFDAY function returns the local
date and time with time zone information. </p>
@@ -2391,7 +2426,7 @@ FROM (VALUES(1));
 +------------------------+-----------+
 | 2015-03-30 20:49:00.0  | UTC       |
 +------------------------+-----------+
-1 row selected (0.097 seconds)
+1 row selected (0.097 seconds)  
 </code></pre></div>
 <!-- DRILL-448 Support timestamp with time zone -->
 
diff --git a/docs/mapr-db-format/index.html b/docs/mapr-db-format/index.html
index bbd9eff..51beca9 100644
--- a/docs/mapr-db-format/index.html
+++ b/docs/mapr-db-format/index.html
@@ -1318,7 +1318,7 @@
 
     </div>
 
-     Jun 26, 2018
+     May 24, 2019
 
     <link href="/css/docpage.css" rel="stylesheet" type="text/css">
 
@@ -1335,7 +1335,9 @@
 <p><strong>Example</strong>  </p>
 <div class="highlight"><pre><code class="language-text" data-lang="text">
  SELECT * FROM mfs.`/users/max/mytable`;   
 </code></pre></div>
-<p><strong>Note:</strong> Starting in Drill 1.14, the MapR Drill installation
package includes a hive-maprdb-json-handler, which enables you to create Hive external tables
from MapR-DB JSON tables and then query the tables using the Hive schema. Drill can use the
native Drill reader to read the Hive external tables. The native Drill reader enables Drill
to perform faster reads of data and apply filter pushdown optimizations. The hive-maprdb-json-handler
is not included in the Apache Dril [...]
+<p>Starting in Drill 1.14, the MapR Drill installation package includes a hive-maprdb-json-handler,
which enables you to create Hive external tables from MapR-DB JSON tables and then query the
tables using the Hive schema. Drill can use the native Drill reader to read the Hive external
tables. The native Drill reader enables Drill to perform faster reads of data and apply filter
pushdown optimizations. The hive-maprdb-json-handler is not included in the Apache Drill installation
package.  </p>
+
+<p>Starting in Drill 1.16, you can include the <code>readTimestampWithZoneOffset</code>
option in the maprdb format plugin configuration. When enabled (set to &#39;true&#39;),
Drill converts timestamp values from UTC to local time zone when reading the values from MapR
Database. The option is disabled by default and does not impact the <code>store.hive.maprdb_json.read_timestamp_with_timezone_offset</code>
setting.  </p>
 
     
       
diff --git a/docs/refresh-table-metadata/index.html b/docs/refresh-table-metadata/index.html
index 4ed3e5c..2031eb7 100644
--- a/docs/refresh-table-metadata/index.html
+++ b/docs/refresh-table-metadata/index.html
@@ -1320,7 +1320,7 @@
 
     </div>
 
-     Apr 30, 2019
+     May 24, 2019
 
     <link href="/css/docpage.css" rel="stylesheet" type="text/css">
 
@@ -1407,7 +1407,10 @@ Sets the number of row groups that a table can have. You can increase
the thresh
 
 <h2 id="limitations">Limitations</h2>
 
-<p>Currently, Drill does not support runtime rowgroup pruning. </p>
+<ul>
+<li>Drill does not support runtime rowgroup pruning.<br></li>
+<li>REFRESH TABLE METADATA does not count null values for decimal, varchar, and interval
data types.</li>
+</ul>
 
 <h2 id="examples">Examples</h2>
 
diff --git a/docs/running-drill-on-docker/index.html b/docs/running-drill-on-docker/index.html
index e465f38..f07b082 100644
--- a/docs/running-drill-on-docker/index.html
+++ b/docs/running-drill-on-docker/index.html
@@ -1320,15 +1320,15 @@
 
     </div>
 
-     May 2, 2019
+     May 24, 2019
 
     <link href="/css/docpage.css" rel="stylesheet" type="text/css">
 
     <div class="int_text" align="left">
       
-        <p>Starting in Drill 1.14, you can run Drill in a <a href="https://www.docker.com/what-container#/package_software">Docker
container</a>. Running Drill in a container is the simplest way to start using Drill;
all you need is the Docker client installed on your machine. You simply run a Docker command,
and your Docker client downloads the Drill Docker image from the apache-drill repository on
<a href="https://docs.docker.com/docker-hub/">Docker Hub</a> and then brings up
a contain [...]
+        <p>Starting in Drill 1.14, you can run Drill in a <a href="https://www.docker.com/what-container#/package_software">Docker
container</a>. Running Drill in a container is the simplest way to start using Drill;
all you need is the Docker client installed on your machine. You simply run a Docker command,
and your Docker client downloads the Drill Docker image from the apache-drill repository on
<a href="https://docs.docker.com/docker-hub/">Docker Hub</a> and brings up a container
wi [...]
 
-<p><strong>Note:</strong> Currently, you can only run Drill in embedded
mode in a Docker container. Embedded mode is when a single instance of Drill runs on a node
or in a container. You do not have to perform any configuration tasks when Drill runs in embedded
mode.  </p>
+<p>Currently, you can only run Drill in embedded mode in a Docker container. Embedded
mode is when a single instance of Drill runs on a node or in a container. You do not have
to perform any configuration tasks when Drill runs in embedded mode.  </p>
 
 <h2 id="prerequisite">Prerequisite</h2>
 
@@ -1372,7 +1372,7 @@
 </tr>
 <tr>
 <td><code>drill/apache-drill:&lt;version&gt;</code></td>
-<td>The Docker Hub repository and tag. In the following   example, <code>drill/apache-drill</code>
is   the repository and <code>1.15.0</code>   is the tag:     <code>drill/apache-drill:1.16.0</code>
    The tag correlates with the version of Drill. When a new version of Drill   is available,
you can use the new version as the tag.</td>
+<td>The Docker Hub repository and tag. In the following   example, <code>drill/apache-drill</code>
is   the repository and <code>1.16.0</code>   is the tag:     <code>drill/apache-drill:1.16.0</code>
    The tag correlates with the version of Drill. When a new version of Drill   is available,
you can use the new version as the tag.</td>
 </tr>
 <tr>
 <td><code>bin/bash</code></td>
@@ -1382,13 +1382,13 @@
 
 <h3 id="running-the-drill-docker-container-in-foreground-mode">Running the Drill Docker
Container in Foreground Mode</h3>
 
-<p>Open a terminal window (Command Prompt or PowerShell, but not PowerShell ISE) and
then issue the following command and opitons to connect to SQLLine (the Drill shell):   </p>
+<p>Open a terminal window (Command Prompt or PowerShell, but not PowerShell ISE) and
then issue the following command and options to connect to SQLLine (the Drill shell):   </p>
 <div class="highlight"><pre><code class="language-text" data-lang="text">
  docker run -i --name drill-1.16.0 -p 8047:8047 -t drill/apache-drill:1.16.0 /bin/bash  
 </code></pre></div>
 <p>When you issue the docker run command, the Drill process starts in a container.
SQLLine prints a message, and the prompt appears:  </p>
 <div class="highlight"><pre><code class="language-text" data-lang="text">
  Jun 29, 2018 3:28:21 AM org.glassfish.jersey.server.ApplicationHandler initialize
    INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26...
-   apache drill 1.15.0 
+   apache drill 1.16.0 
    &quot;json ain&#39;t no thang&quot;
    0: jdbc:drill:zk=local&gt;  
 </code></pre></div>
@@ -1409,7 +1409,7 @@
    $ /opt/drill/bin/drill-localhost  
 </code></pre></div>
 <p>After you issue the commands, the Drill process starts in a container. SQLLine prints
a message, and the prompt appears:  </p>
-<div class="highlight"><pre><code class="language-text" data-lang="text">
  apache drill 1.15.0 
+<div class="highlight"><pre><code class="language-text" data-lang="text">
  apache drill 1.16.0 
    &quot;json ain&#39;t no thang&quot;
    0: jdbc:drill:drillbit=localhost&gt;  
 </code></pre></div>
diff --git a/feed.xml b/feed.xml
index c38cf45..1cfdec8 100644
--- a/feed.xml
+++ b/feed.xml
@@ -6,8 +6,8 @@
 </description>
     <link>/</link>
     <atom:link href="/feed.xml" rel="self" type="application/rss+xml"/>
-    <pubDate>Tue, 07 May 2019 16:52:47 -0700</pubDate>
-    <lastBuildDate>Tue, 07 May 2019 16:52:47 -0700</lastBuildDate>
+    <pubDate>Fri, 24 May 2019 15:54:55 -0700</pubDate>
+    <lastBuildDate>Fri, 24 May 2019 15:54:55 -0700</lastBuildDate>
     <generator>Jekyll v2.5.2</generator>
     
       <item>


Mime
View raw message