beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From git-site-r...@apache.org
Subject [beam] branch asf-site updated: Publishing website 2020/08/04 18:02:04 at commit 5ded4ae
Date Tue, 04 Aug 2020 18:02:16 GMT
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new c5eeb3c  Publishing website 2020/08/04 18:02:04 at commit 5ded4ae
c5eeb3c is described below

commit c5eeb3c521f2e9b3e450210a2272a29669d71f61
Author: jenkins <users@infra.apache.org>
AuthorDate: Tue Aug 4 18:02:04 2020 +0000

    Publishing website 2020/08/04 18:02:04 at commit 5ded4ae
---
 .../documentation/dsls/sql/walkthrough/index.html  |  2 +-
 .../python/aggregation/sample/index.html           | 42 ++++++++++++++++++++--
 website/generated-content/sitemap.xml              |  2 +-
 3 files changed, 41 insertions(+), 5 deletions(-)

diff --git a/website/generated-content/documentation/dsls/sql/walkthrough/index.html b/website/generated-content/documentation/dsls/sql/walkthrough/index.html
index fce9606..3f3be2f 100644
--- a/website/generated-content/documentation/dsls/sql/walkthrough/index.html
+++ b/website/generated-content/documentation/dsls/sql/walkthrough/index.html
@@ -78,7 +78,7 @@ to either a single <code>PCollection</code> or a <code>PCollectionTuple</code>
w
           <span class=o>.</span><span class=na>builder</span><span
class=o>()</span>
           <span class=o>.</span><span class=na>addInt32Field</span><span
class=o>(</span><span class=s>&#34;appId&#34;</span><span
class=o>)</span>
           <span class=o>.</span><span class=na>addInt32Field</span><span
class=o>(</span><span class=s>&#34;reviewerId&#34;</span><span
class=o>)</span>
-          <span class=o>.</span><span class=na>withFloatField</span><span
class=o>(</span><span class=s>&#34;rating&#34;</span><span
class=o>)</span>
+          <span class=o>.</span><span class=na>addFloatField</span><span
class=o>(</span><span class=s>&#34;rating&#34;</span><span
class=o>)</span>
           <span class=o>.</span><span class=na>addDateTimeField</span><span
class=o>(</span><span class=s>&#34;rowtime&#34;</span><span
class=o>)</span>
           <span class=o>.</span><span class=na>build</span><span
class=o>();</span>
     
diff --git a/website/generated-content/documentation/transforms/python/aggregation/sample/index.html
b/website/generated-content/documentation/transforms/python/aggregation/sample/index.html
index 37a1dac..24a4d16 100644
--- a/website/generated-content/documentation/transforms/python/aggregation/sample/index.html
+++ b/website/generated-content/documentation/transforms/python/aggregation/sample/index.html
@@ -1,10 +1,46 @@
 <!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta
http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1"><title>Sample</title><meta
name=description content="Apache Beam is an open source, unified model and set of language-specific
SDKs for defining and executing data processing workflows, and also data ingestion and integration
flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Langua [...]
 <span class=sr-only>Toggle navigation</span>
 <span class=icon-bar></span><span class=icon-bar></span><span
class=icon-bar></span></button>
-<a href=/ class=navbar-brand><img alt=Brand style=height:25px src=/images/beam_logo_navbar.png></a></div><div
class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><ul
class="nav navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
-Pydoc</a></table><br><br><p>Transforms for taking samples of
the elements in a collection, or
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px src=/images/beam_logo_navbar.png></a></div><div
class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><ul
class="nav navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a
href=/documentation/>Documentation</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a
href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a
href=/roadmap/>Roadmap</a></li>< [...]
+Pydoc</a></td></table><p><br><br><br></p><p>Transforms
for taking samples of the elements in a collection, or
 samples of the values associated with each key in a collection of
-key-value pairs.</p><h2 id=examples>Examples</h2><p>See <a href=https://issues.apache.org/jira/browse/BEAM-7390>BEAM-7390</a>
for updates.</p><h2 id=related-transforms>Related transforms</h2><ul><li><a
href=/documentation/transforms/python/aggregation/top>Top</a> finds the largest or
smallest element.</li></ul></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div class=footer__cols__col><div
class=footer__cols__col__logo><img src=/images/beam_logo_cir [...]
+key-value pairs.</p><h2 id=examples>Examples</h2><p>In the following
example, we create a pipeline with a <code>PCollection</code>.
+Then, we get a random sample of elements in different ways.</p><h3 id=example-1-sample-elements-from-a-pcollection>Example
1: Sample elements from a PCollection</h3><p>We use <code>Sample.FixedSizeGlobally()</code>
to get a fixed-size random sample of elements from the <em>entire</em> <code>PCollection</code>.</p><div
class=language-py><div class=highlight><pre class=chroma><code class=language-py
data-lang=py><span class=kn>import</span> <span class=nn>apache_beam</span>
<span class=kn> [...]
+
+<span class=k>with</span> <span class=n>beam</span><span class=o>.</span><span
class=n>Pipeline</span><span class=p>()</span> <span class=k>as</span>
<span class=n>pipeline</span><span class=p>:</span>
+  <span class=n>sample</span> <span class=o>=</span> <span class=p>(</span>
+      <span class=n>pipeline</span>
+      <span class=o>|</span> <span class=s1>&#39;Create produce&#39;</span>
<span class=o>&gt;&gt;</span> <span class=n>beam</span><span
class=o>.</span><span class=n>Create</span><span class=p>([</span>
+          <span class=s1>&#39;🍓 Strawberry&#39;</span><span class=p>,</span>
+          <span class=s1>&#39;🥕 Carrot&#39;</span><span class=p>,</span>
+          <span class=s1>&#39;🍆 Eggplant&#39;</span><span class=p>,</span>
+          <span class=s1>&#39;🍅 Tomato&#39;</span><span class=p>,</span>
+          <span class=s1>&#39;🥔 Potato&#39;</span><span class=p>,</span>
+      <span class=p>])</span>
+      <span class=o>|</span> <span class=s1>&#39;Sample N elements&#39;</span>
<span class=o>&gt;&gt;</span> <span class=n>beam</span><span
class=o>.</span><span class=n>combiners</span><span class=o>.</span><span
class=n>Sample</span><span class=o>.</span><span class=n>FixedSizeGlobally</span><span
class=p>(</span><span class=mi>3</span><span class=p>)</span>
+      <span class=o>|</span> <span class=n>beam</span><span class=o>.</span><span
class=n>Map</span><span class=p>(</span><span class=k>print</span><span
class=p>))</span></code></pre></div></div><p class=notebook-skip>Output:</p><div
class=notebook-skip><pre><code>[&#39;🥕 Carrot&#39;, &#39;🍆
Eggplant&#39;, &#39;🍅 Tomato&#39;]</code></pre></div><table
align=left style=margin-right:1em class=.language-py><td><a class=button target=_blank
href=https://github.com/apache/beam/blob/master/sdk [...]
+
+<span class=k>with</span> <span class=n>beam</span><span class=o>.</span><span
class=n>Pipeline</span><span class=p>()</span> <span class=k>as</span>
<span class=n>pipeline</span><span class=p>:</span>
+  <span class=n>samples_per_key</span> <span class=o>=</span> <span
class=p>(</span>
+      <span class=n>pipeline</span>
+      <span class=o>|</span> <span class=s1>&#39;Create produce&#39;</span>
<span class=o>&gt;&gt;</span> <span class=n>beam</span><span
class=o>.</span><span class=n>Create</span><span class=p>([</span>
+          <span class=p>(</span><span class=s1>&#39;spring&#39;</span><span
class=p>,</span> <span class=s1>&#39;🍓&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;spring&#39;</span><span
class=p>,</span> <span class=s1>&#39;🥕&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;spring&#39;</span><span
class=p>,</span> <span class=s1>&#39;🍆&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;spring&#39;</span><span
class=p>,</span> <span class=s1>&#39;🍅&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;summer&#39;</span><span
class=p>,</span> <span class=s1>&#39;🥕&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;summer&#39;</span><span
class=p>,</span> <span class=s1>&#39;🍅&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;summer&#39;</span><span
class=p>,</span> <span class=s1>&#39;🌽&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;fall&#39;</span><span
class=p>,</span> <span class=s1>&#39;🥕&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;fall&#39;</span><span
class=p>,</span> <span class=s1>&#39;🍅&#39;</span><span
class=p>),</span>
+          <span class=p>(</span><span class=s1>&#39;winter&#39;</span><span
class=p>,</span> <span class=s1>&#39;🍆&#39;</span><span
class=p>),</span>
+      <span class=p>])</span>
+      <span class=o>|</span> <span class=s1>&#39;Samples per key&#39;</span>
<span class=o>&gt;&gt;</span> <span class=n>beam</span><span
class=o>.</span><span class=n>combiners</span><span class=o>.</span><span
class=n>Sample</span><span class=o>.</span><span class=n>FixedSizePerKey</span><span
class=p>(</span><span class=mi>3</span><span class=p>)</span>
+      <span class=o>|</span> <span class=n>beam</span><span class=o>.</span><span
class=n>Map</span><span class=p>(</span><span class=k>print</span><span
class=p>))</span></code></pre></div></div><p class=notebook-skip>Output:</p><div
class=notebook-skip><pre><code>(&#39;spring&#39;, [&#39;🍓&#39;,
&#39;🥕&#39;, &#39;🍆&#39;])
+(&#39;summer&#39;, [&#39;🥕&#39;, &#39;🍅&#39;, &#39;🌽&#39;])
+(&#39;fall&#39;, [&#39;🥕&#39;, &#39;🍅&#39;])
+(&#39;winter&#39;, [&#39;🍆&#39;])</code></pre></div><table
align=left style=margin-right:1em class=.language-py><td><a class=button target=_blank
href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/snippets/transforms/aggregation/sample.py><img
src=https://www.tensorflow.org/images/GitHub-Mark-32px.png width=32px height=32px alt="View
source code"> View source code</a></td></table><p><br><br><br></p><h2
id=related-transforms>Related transforms</h2><ul><li><a  [...]
+Pydoc</a></td></table><p><br><br><br></p></div></div><footer
class=footer><div class=footer__contained><div class=footer__cols><div class=footer__cols__col><div
class=footer__cols__col__logo><img src=/images/beam_logo_circle.svg class=footer__logo
alt="Beam logo"></div><div class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg
class=footer__logo alt="Apache logo"></div></div><div class="footer__cols__col
footer__cols__col--md"><div class=footer__cols__col__title>Start</di [...]
 <a href=http://www.apache.org>The Apache Software Foundation</a>
 | <a href=/privacy_policy>Privacy Policy</a>
 | <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam,
the Beam logo, and the Apache feather logo are either registered trademarks or trademarks
of The Apache Software Foundation. All other products or name brands are trademarks of their
respective holders, including The Apache Software Foundation.</div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index 15e99ca..61803e0 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.23.0/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/blog/b
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.23.0/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2020-07-29T14:52:28-07:00</lastmod></url><url><loc>/blog/b
[...]
\ No newline at end of file


Mime
View raw message