beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From git-site-r...@apache.org
Subject [beam] branch asf-site updated: Publishing website 2021/01/20 18:02:55 at commit 8d6fd6a
Date Wed, 20 Jan 2021 18:03:20 GMT
This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git


The following commit(s) were added to refs/heads/asf-site by this push:
     new 21c779c  Publishing website 2021/01/20 18:02:55 at commit 8d6fd6a
21c779c is described below

commit 21c779c038fe567a96aa8afd865e5e68459d9e59
Author: jenkins <builds@apache.org>
AuthorDate: Wed Jan 20 18:02:56 2021 +0000

    Publishing website 2021/01/20 18:02:55 at commit 8d6fd6a
---
 .../generated-content/blog/beam-2.27.0/index.html  |   2 +-
 website/generated-content/blog/index.html          |   9 +-
 website/generated-content/blog/index.xml           | 124 +++++++++++---------
 .../blog/kafka-to-pubsub-example/index.html        |  37 ++++++
 .../generated-content/categories/blog/index.xml    | 124 +++++++++++---------
 website/generated-content/categories/index.xml     |   2 +-
 .../generated-content/categories/java/index.html   |   7 ++
 .../generated-content/categories/java/index.xml    |  69 +++++++++++
 website/generated-content/feed.xml                 | 129 ++++++++++++---------
 website/generated-content/index.html               |   2 +-
 website/generated-content/sitemap.xml              |   2 +-
 11 files changed, 338 insertions(+), 169 deletions(-)

diff --git a/website/generated-content/blog/beam-2.27.0/index.html b/website/generated-content/blog/beam-2.27.0/index.html
index 9bd3ec7..8176f2c 100644
--- a/website/generated-content/blog/beam-2.27.0/index.html
+++ b/website/generated-content/blog/beam-2.27.0/index.html
@@ -6,7 +6,7 @@
 Pablo Estrada [<a href=https://twitter.com/polecitoem>@polecitoem</a>]</p></header><div class=post-content itemprop=articleBody><p>We are happy to present the new 2.27.0 release of Apache Beam. This release includes both improvements and new functionality.
 See the <a href=/get-started/downloads/#2270-2020-12-22>download page</a> for this release.
 For more information on changes in 2.27.0, check out the
-<a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12349380">detailed release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Java 11 Containers are now published with all Beam releases.</li><li>There is a new transform <code>ReadAllFromBigQuery</code> that can receive multiple requests to read data from BigQuery at pipeline runtime. See <a href=https://github.com/apache/beam/pull/13170>PR 13170</a>, and <a href=https://issues.apache.org/jir [...]
+<a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12349380">detailed release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Java 11 Containers are now published with all Beam releases.</li><li>There is a new transform <code>ReadAllFromBigQuery</code> that can receive multiple requests to read data from BigQuery at pipeline runtime. See <a href=https://github.com/apache/beam/pull/13170>PR 13170</a>, and <a href=https://issues.apache.org/jir [...]
 Andrew Pilloud, andreyKaparulin, Ashwin Ramaswami, Boyuan Zhang, Brent Worden, Brian Hulette,
 Carlos Marin, Chamikara Jayalath, Costi Ciudatu, Damon Douglas, Daniel Collins,
 Daniel Oliveira, David Huntsperger, David Lu, David Moravek, David Wrede,
diff --git a/website/generated-content/blog/index.html b/website/generated-content/blog/index.html
index 9610068..b2939c9 100644
--- a/website/generated-content/blog/index.html
+++ b/website/generated-content/blog/index.html
@@ -1,7 +1,14 @@
 <!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1"><title>Blogs</title><meta name=description content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languag [...]
 <span class=sr-only>Toggle navigation</span>
 <span class=icon-bar></span><span class=icon-bar></span><span class=icon-bar></span></button>
-<a href=/ class=navbar-brand><img alt=Brand style=height:25px src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><ul class="nav navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a href=/documentation/>Documentation</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a href=/roadmap/>Roadmap</a></li>< [...]
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><ul class="nav navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a href=/documentation/>Documentation</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a href=/roadmap/>Roadmap</a></li>< [...]
+•
+Artur Khanin
+,
+Ilya Kozyrev
+,
+&
+Alex Kosolapov</i></p>In this blog post we present an example that creates a pipeline to read data from a single topic or multiple topics from Apache Kafka and write data into a topic in Google Pub/Sub.<p><a class="btn btn-default btn-sm" href=/blog/kafka-to-pubsub-example/ role=button>Read more&nbsp;<span class="glyphicon glyphicon-menu-right" aria-hidden=true></span></a></p><hr><h3><a class=post-link href=/blog/beam-2.27.0/>Apache Beam 2.27.0</a></h3><p><i>Jan 7, 2021
 •
 Pablo Estrada [<a href=https://twitter.com/polecitoem>@polecitoem</a>]</i></p>We are happy to present the new 2.<p><a class="btn btn-default btn-sm" href=/blog/beam-2.27.0/ role=button>Read more&nbsp;<span class="glyphicon glyphicon-menu-right" aria-hidden=true></span></a></p><hr><h3><a class=post-link href=/blog/dataframe-api-preview-available/>DataFrame API Preview now Available!</a></h3><p><i>Dec 16, 2020
 •
diff --git a/website/generated-content/blog/index.xml b/website/generated-content/blog/index.xml
index 7e85dfb..1f81d0d 100644
--- a/website/generated-content/blog/index.xml
+++ b/website/generated-content/blog/index.xml
@@ -1,4 +1,72 @@
-<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Beam – Blogs</title><link>/blog/</link><description>Recent content in Blogs on Apache Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Thu, 07 Jan 2021 12:00:00 -0800</lastBuildDate><atom:link href="/blog/index.xml" rel="self" type="application/rss+xml"/><item><title>Blog: Apache Beam 2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan 2021 12:00:00 -0800</pubDate><gui [...]
+<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Beam – Blogs</title><link>/blog/</link><description>Recent content in Blogs on Apache Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Fri, 15 Jan 2021 00:00:01 -0800</lastBuildDate><atom:link href="/blog/index.xml" rel="self" type="application/rss+xml"/><item><title>Blog: Example to ingest data from Apache Kafka to Google Cloud Pub/Sub</title><link>/blog/kafka-to-pubsub-example/</l [...]
+&lt;!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+&lt;p>In this blog post we present an example that creates a pipeline to read data from a single topic or
+multiple topics from &lt;a href="https://kafka.apache.org/">Apache Kafka&lt;/a> and write data into a topic
+in &lt;a href="https://cloud.google.com/pubsub">Google Pub/Sub&lt;/a>. The example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution that you can just &lt;em>&amp;rdquo;
+plug&amp;rsquo;n&amp;rsquo;play&amp;rdquo;&lt;/em>.&lt;/p>
+&lt;p>This end-to-end example is included
+in &lt;a href="https://beam.apache.org/blog/beam-2.27.0/">Apache Beam release 2.27&lt;/a>
+and can be downloaded &lt;a href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22">here&lt;/a>.&lt;/p>
+&lt;p>We hope you will find this example useful for setting up data pipelines between Kafka and Pub/Sub.&lt;/p>
+&lt;h1 id="example-specs">Example specs&lt;/h1>
+&lt;p>Supported data formats:&lt;/p>
+&lt;ul>
+&lt;li>Serializable plain text formats, such as JSON&lt;/li>
+&lt;li>&lt;a href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage">PubSubMessage&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported input source configurations:&lt;/p>
+&lt;ul>
+&lt;li>Single or multiple Apache Kafka bootstrap servers&lt;/li>
+&lt;li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL connection&lt;/li>
+&lt;li>Secrets vault service &lt;a href="https://www.vaultproject.io/">HashiCorp Vault&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported destination configuration:&lt;/p>
+&lt;ul>
+&lt;li>Single Google Pub/Sub topic&lt;/li>
+&lt;/ul>
+&lt;p>In a simple scenario, the example will create an Apache Beam pipeline that will read messages from a
+source Kafka server with a source topic, and stream the text messages into specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication, that can be performed
+over plaintext or SSL encrypted connection. The example supports using a single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets vault service with
+Kafka username and password, currently supporting HashiCorp Vault.&lt;/p>
+&lt;h1 id="where-can-i-run-this-example">Where can I run this example?&lt;/h1>
+&lt;p>There are two ways to execute the pipeline.&lt;/p>
+&lt;ol>
+&lt;li>Locally. This way has many options - run directly from your IntelliJ, or create &lt;code>.jar&lt;/code> file and
+run it in the terminal, or use your favourite method of running Beam pipelines.&lt;/li>
+&lt;li>In &lt;a href="https://cloud.google.com/">Google Cloud&lt;/a> using Google
+Cloud &lt;a href="https://cloud.google.com/dataflow">Dataflow&lt;/a>:
+&lt;ul>
+&lt;li>With &lt;code>gcloud&lt;/code> command-line tool you can create
+a &lt;a href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates">Flex Template&lt;/a>
+out of this Beam example and execute it in Google Cloud Platform. &lt;em>This requires corresponding
+modifications of the example to turn it into a template.&lt;/em>&lt;/li>
+&lt;li>This example exists as
+a &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub">Flex Template version&lt;/a>
+within &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates">Google Cloud Dataflow Template Pipelines&lt;/a>
+repository and can be run with no additional code modifications.&lt;/li>
+&lt;/ul>
+&lt;/li>
+&lt;/ol>
+&lt;h1 id="next-steps">Next Steps&lt;/h1>
+&lt;p>Give this &lt;strong>Beam end-to-end example&lt;/strong> a try. If you are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already using Beam, we hope
+some code samples in it will be useful for your use cases.&lt;/p>
+&lt;p>Please
+&lt;a href="https://beam.apache.org/community/contact-us/">let us know&lt;/a> if you encounter any issues.&lt;/p></description></item><item><title>Blog: Apache Beam 2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan 2021 12:00:00 -0800</pubDate><guid>/blog/beam-2.27.0/</guid><description>
 &lt;!--
 Licensed under the Apache License, Version 2.0 (the "License");
 you may not use this file except in compliance with the License.
@@ -32,6 +100,7 @@ For more information on changes in 2.27.0, check out the
 &lt;li>Added Cloud Bigtable Provider extension to Beam SQL (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11173">BEAM-11173&lt;/a>, &lt;a href="https://issues.apache.org/jira/browse/BEAM-11373">BEAM-11373&lt;/a>)&lt;/li>
 &lt;li>Added a schema provider for thrift data (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11338">BEAM-11338&lt;/a>)&lt;/li>
 &lt;li>Added combiner packing pipeline optimization to Dataflow runner. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-10641">BEAM-10641&lt;/a>)&lt;/li>
+&lt;li>Added an example to ingest data from Apache Kafka to Google Pub/Sub. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11065">BEAM-11065&lt;/a>)&lt;/li>
 &lt;/ul>
 &lt;h2 id="breaking-changes">Breaking Changes&lt;/h2>
 &lt;ul>
@@ -5333,55 +5402,4 @@ see the level of support for this new model feature on your favorite
 backend(s).&lt;/p>
 &lt;p>And please do join the community at
 &lt;a href="/get-started/support">user@beam.apache.org&lt;/a>. We&amp;rsquo;d love to
-hear from you.&lt;/p></description></item><item><title>Blog: Media recap of the Apache Beam graduation</title><link>/blog/graduation-media-recap/</link><pubDate>Wed, 01 Feb 2017 00:00:01 -0800</pubDate><guid>/blog/graduation-media-recap/</guid><description>
-&lt;!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-&lt;p>One year ago today Apache Beam was accepted into incubation at the Apache
-Software Foundation. The community&amp;rsquo;s work over the past year culminated, just
-over three weeks ago, with an &lt;a href="/blog/2017/01/10/beam-graduates.html">announcement&lt;/a>
-that Apache Beam has successfully graduated as a new Top-Level Project at the
-foundation. Graduation sparked an additional interest in the project, from
-corporate endorsements, news articles, interviews, to the volume of traffic to
-our website and mailing lists.&lt;/p>
-&lt;p>Corporate endorsements include Google, PayPal, Talend, data Artisans, and
-others. You can read more in the following blog posts:&lt;/p>
-&lt;ul>
-&lt;li>Google: &amp;ldquo;&lt;a href="https://opensource.googleblog.com/2017/01/apache-beam-graduates.html">Apache Beam graduates to a top-level project&lt;/a>&amp;rdquo; by Tyler Akidau.&lt;/li>
-&lt;li>Talend: &amp;ldquo;&lt;a href="https://www.talend.com/blog/2017/01/13/future-apache-beam-now-top-level-apache-software-foundation-project/">The Future of Apache Beam, Now a Top-Level Apache Software Foundation Project&lt;/a>&amp;rdquo; by Jean-Baptiste Onofré.&lt;/li>
-&lt;li>Talend: &amp;ldquo;&lt;a href="https://www.talend.com/blog/2017/01/23/apache-beam-way-greater-data-agility/?utm_medium=socialpost&amp;amp;utm_source=twitter&amp;amp;utm_campaign=blog">Apache Beam Your Way to Greater Data Agility&lt;/a>&amp;rdquo; by Shane Kent.&lt;/li>
-&lt;li>Google: &amp;ldquo;&lt;a href="https://cloud.google.com/blog/big-data/2017/01/apache-beam-graduates-from-incubation-try-it-today-on-google-cloud-dataflow">Apache Beam graduates from incubation: Try it today on Google Cloud Dataflow&lt;/a>&amp;rdquo; by Frances Perry.&lt;/li>
-&lt;/ul>
-&lt;p>News coverage started with the Apache Software Foundation’s press release in
-&lt;a href="https://globenewswire.com/news-release/2017/01/10/904692/0/en/The-Apache-Software-Foundation-Announces-Apache-Beam-as-a-Top-Level-Project.html">Nasdaq GlobeNewswire&lt;/a>,
-and followed by coverage in many independent outlets. Some of those in English
-include:&lt;/p>
-&lt;ul>
-&lt;li>ZDNet: &amp;ldquo;&lt;a href="https://www.zdnet.com/article/apache-beam-and-spark-new-coopetition-for-squashing-the-lambda-architecture/">Apache Beam and Spark: New coopetition for squashing the Lambda Architecture?&lt;/a>&amp;rdquo; by Tony Baer.&lt;/li>
-&lt;li>Datanami: &amp;ldquo;&lt;a href="https://www.datanami.com/2017/01/10/google-lauds-outside-influence-apache-beam/">Google Lauds Outside Influence on Apache Beam&lt;/a>&amp;rdquo; by Alex Woodie.&lt;/li>
-&lt;li>InfoWorld / JavaWorld: &amp;ldquo;&lt;a href="https://www.infoworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html">Apache Beam unifies batch and streaming for big data&lt;/a>&amp;rdquo; by Serdar Yegulalp, and republished in &lt;a href="https://www.javaworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html">JavaWorld&lt;/a>.&lt;/li>
-&lt;li>JAXenter: &amp;ldquo;&lt;a href="https://jaxenter.com/apache-beam-interview-131314.html">In a way, Apache Beam is the glue that connects many big data systems together&lt;/a>&amp;rdquo; by Kypriani Sinaris.&lt;/li>
-&lt;li>OStatic: &amp;ldquo;Apache Beam Unifies Batch and Streaming Data Processing&amp;rdquo; by Sam Dean. &lt;!-- http://ostatic.com/blog/apache-beam-unifies-batch-and-streaming-data-processing -->&lt;/li>
-&lt;li>Enterprise Apps Today: &amp;ldquo;&lt;a href="http://www.enterpriseappstoday.com/business-intelligence/data-analytics/apache-beam-graduates-to-help-define-streaming-data-processing.html">Apache Beam Graduates to Help Define Streaming Data Processing&lt;/a>&amp;rdquo; by Sean Michael Kerner.&lt;/li>
-&lt;li>The Register: &amp;ldquo;&lt;a href="https://www.theregister.co.uk/2017/01/10/google_must_be_ibeamiing_as_apache_announces_its_new_top_level_projects/">Google must be Beaming as Apache announces its new top-level projects&lt;/a>&amp;rdquo; by Alexander J. Martin.&lt;/li>
-&lt;li>SiliconANGLE: &amp;ldquo;&lt;a href="https://siliconangle.com/blog/2017/01/11/apache-software-foundation-announces-2-top-level-projects/">Apache Software Foundation announces two more top-level open source projects&lt;/a>&amp;rdquo; by Mike Wheatley.&lt;/li>
-&lt;li>SD Times: &amp;ldquo;&lt;a href="https://sdtimes.com/apache-beam-goes-top-level/">Apache Beam goes top level&lt;/a>&amp;rdquo; by Alex Handy.&lt;/li>
-&lt;/ul>
-&lt;p>Graduation and media coverage helped push Beam website traffic to record levels.
-The website traffic, measured in unique sessions per hour, peaked at more than
-15 times above the previous week’s numbers. In a steady state, the traffic is
-several times larger than before graduation.&lt;/p>
-&lt;p>Hopefully these perspectives entice you to join us on this exciting ride, either
-as a user or a contributor, as we work towards our first release with API
-stability. If you’d like to try out Apache Beam today, check out the latest
-&lt;a href="/get-started/downloads/">0.4.0 release&lt;/a>. We welcome
-contribution and participation from anyone through our mailing lists, issue
-tracker, pull requests, and events.&lt;/p></description></item></channel></rss>
\ No newline at end of file
+hear from you.&lt;/p></description></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/blog/kafka-to-pubsub-example/index.html b/website/generated-content/blog/kafka-to-pubsub-example/index.html
new file mode 100644
index 0000000..0f6bfc6
--- /dev/null
+++ b/website/generated-content/blog/kafka-to-pubsub-example/index.html
@@ -0,0 +1,37 @@
+<!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1"><title>Example to ingest data from Apache Kafka to Google Cloud Pub/Sub</title><meta name=description content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterpr [...]
+<span class=sr-only>Toggle navigation</span>
+<span class=icon-bar></span><span class=icon-bar></span><span class=icon-bar></span></button>
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><ul class="nav navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a href=/documentation/>Documentation</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a href=/roadmap/>Roadmap</a></li>< [...]
+•
+Artur Khanin
+,
+Ilya Kozyrev
+,
+&
+Alex Kosolapov</p></header><div class=post-content itemprop=articleBody><p>In this blog post we present an example that creates a pipeline to read data from a single topic or
+multiple topics from <a href=https://kafka.apache.org/>Apache Kafka</a> and write data into a topic
+in <a href=https://cloud.google.com/pubsub>Google Pub/Sub</a>. The example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution that you can just <em>&rdquo;
+plug&rsquo;n&rsquo;play&rdquo;</em>.</p><p>This end-to-end example is included
+in <a href=https://beam.apache.org/blog/beam-2.27.0/>Apache Beam release 2.27</a>
+and can be downloaded <a href=https://beam.apache.org/get-started/downloads/#2270-2020-12-22>here</a>.</p><p>We hope you will find this example useful for setting up data pipelines between Kafka and Pub/Sub.</p><h1 id=example-specs>Example specs</h1><p>Supported data formats:</p><ul><li>Serializable plain text formats, such as JSON</li><li><a href=https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage>PubSubMessage</a></li></ul><p>Supported input source configurations:</p>< [...]
+source Kafka server with a source topic, and stream the text messages into specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication, that can be performed
+over plaintext or SSL encrypted connection. The example supports using a single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets vault service with
+Kafka username and password, currently supporting HashiCorp Vault.</p><h1 id=where-can-i-run-this-example>Where can I run this example?</h1><p>There are two ways to execute the pipeline.</p><ol><li>Locally. This way has many options - run directly from your IntelliJ, or create <code>.jar</code> file and
+run it in the terminal, or use your favourite method of running Beam pipelines.</li><li>In <a href=https://cloud.google.com/>Google Cloud</a> using Google
+Cloud <a href=https://cloud.google.com/dataflow>Dataflow</a>:<ul><li>With <code>gcloud</code> command-line tool you can create
+a <a href=https://cloud.google.com/dataflow/docs/concepts/dataflow-templates>Flex Template</a>
+out of this Beam example and execute it in Google Cloud Platform. <em>This requires corresponding
+modifications of the example to turn it into a template.</em></li><li>This example exists as
+a <a href=https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub>Flex Template version</a>
+within <a href=https://github.com/GoogleCloudPlatform/DataflowTemplates>Google Cloud Dataflow Template Pipelines</a>
+repository and can be run with no additional code modifications.</li></ul></li></ol><h1 id=next-steps>Next Steps</h1><p>Give this <strong>Beam end-to-end example</strong> a try. If you are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already using Beam, we hope
+some code samples in it will be useful for your use cases.</p><p>Please
+<a href=https://beam.apache.org/community/contact-us/>let us know</a> if you encounter any issues.</p></div></article></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class=footer__cols__col><div class=footer__cols__col__logo><img src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg class=footer__logo alt="Apache logo"></div></div><div class="footer__cols__c [...]
+<a href=http://www.apache.org>The Apache Software Foundation</a>
+| <a href=/privacy_policy>Privacy Policy</a>
+| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/categories/blog/index.xml b/website/generated-content/categories/blog/index.xml
index 1ffb3ec..2336518 100644
--- a/website/generated-content/categories/blog/index.xml
+++ b/website/generated-content/categories/blog/index.xml
@@ -1,4 +1,72 @@
-<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Beam – blog</title><link>/categories/blog/</link><description>Recent content in blog on Apache Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Thu, 07 Jan 2021 12:00:00 -0800</lastBuildDate><atom:link href="/categories/blog/index.xml" rel="self" type="application/rss+xml"/><item><title>Blog: Apache Beam 2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan 2021 12:00:00 [...]
+<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Beam – blog</title><link>/categories/blog/</link><description>Recent content in blog on Apache Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Fri, 15 Jan 2021 00:00:01 -0800</lastBuildDate><atom:link href="/categories/blog/index.xml" rel="self" type="application/rss+xml"/><item><title>Blog: Example to ingest data from Apache Kafka to Google Cloud Pub/Sub</title><link>/blog/kafka-t [...]
+&lt;!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+&lt;p>In this blog post we present an example that creates a pipeline to read data from a single topic or
+multiple topics from &lt;a href="https://kafka.apache.org/">Apache Kafka&lt;/a> and write data into a topic
+in &lt;a href="https://cloud.google.com/pubsub">Google Pub/Sub&lt;/a>. The example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution that you can just &lt;em>&amp;rdquo;
+plug&amp;rsquo;n&amp;rsquo;play&amp;rdquo;&lt;/em>.&lt;/p>
+&lt;p>This end-to-end example is included
+in &lt;a href="https://beam.apache.org/blog/beam-2.27.0/">Apache Beam release 2.27&lt;/a>
+and can be downloaded &lt;a href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22">here&lt;/a>.&lt;/p>
+&lt;p>We hope you will find this example useful for setting up data pipelines between Kafka and Pub/Sub.&lt;/p>
+&lt;h1 id="example-specs">Example specs&lt;/h1>
+&lt;p>Supported data formats:&lt;/p>
+&lt;ul>
+&lt;li>Serializable plain text formats, such as JSON&lt;/li>
+&lt;li>&lt;a href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage">PubSubMessage&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported input source configurations:&lt;/p>
+&lt;ul>
+&lt;li>Single or multiple Apache Kafka bootstrap servers&lt;/li>
+&lt;li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL connection&lt;/li>
+&lt;li>Secrets vault service &lt;a href="https://www.vaultproject.io/">HashiCorp Vault&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported destination configuration:&lt;/p>
+&lt;ul>
+&lt;li>Single Google Pub/Sub topic&lt;/li>
+&lt;/ul>
+&lt;p>In a simple scenario, the example will create an Apache Beam pipeline that will read messages from a
+source Kafka server with a source topic, and stream the text messages into specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication, that can be performed
+over plaintext or SSL encrypted connection. The example supports using a single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets vault service with
+Kafka username and password, currently supporting HashiCorp Vault.&lt;/p>
+&lt;h1 id="where-can-i-run-this-example">Where can I run this example?&lt;/h1>
+&lt;p>There are two ways to execute the pipeline.&lt;/p>
+&lt;ol>
+&lt;li>Locally. This way has many options - run directly from your IntelliJ, or create &lt;code>.jar&lt;/code> file and
+run it in the terminal, or use your favourite method of running Beam pipelines.&lt;/li>
+&lt;li>In &lt;a href="https://cloud.google.com/">Google Cloud&lt;/a> using Google
+Cloud &lt;a href="https://cloud.google.com/dataflow">Dataflow&lt;/a>:
+&lt;ul>
+&lt;li>With &lt;code>gcloud&lt;/code> command-line tool you can create
+a &lt;a href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates">Flex Template&lt;/a>
+out of this Beam example and execute it in Google Cloud Platform. &lt;em>This requires corresponding
+modifications of the example to turn it into a template.&lt;/em>&lt;/li>
+&lt;li>This example exists as
+a &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub">Flex Template version&lt;/a>
+within &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates">Google Cloud Dataflow Template Pipelines&lt;/a>
+repository and can be run with no additional code modifications.&lt;/li>
+&lt;/ul>
+&lt;/li>
+&lt;/ol>
+&lt;h1 id="next-steps">Next Steps&lt;/h1>
+&lt;p>Give this &lt;strong>Beam end-to-end example&lt;/strong> a try. If you are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already using Beam, we hope
+some code samples in it will be useful for your use cases.&lt;/p>
+&lt;p>Please
+&lt;a href="https://beam.apache.org/community/contact-us/">let us know&lt;/a> if you encounter any issues.&lt;/p></description></item><item><title>Blog: Apache Beam 2.27.0</title><link>/blog/beam-2.27.0/</link><pubDate>Thu, 07 Jan 2021 12:00:00 -0800</pubDate><guid>/blog/beam-2.27.0/</guid><description>
 &lt;!--
 Licensed under the Apache License, Version 2.0 (the "License");
 you may not use this file except in compliance with the License.
@@ -32,6 +100,7 @@ For more information on changes in 2.27.0, check out the
 &lt;li>Added Cloud Bigtable Provider extension to Beam SQL (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11173">BEAM-11173&lt;/a>, &lt;a href="https://issues.apache.org/jira/browse/BEAM-11373">BEAM-11373&lt;/a>)&lt;/li>
 &lt;li>Added a schema provider for thrift data (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11338">BEAM-11338&lt;/a>)&lt;/li>
 &lt;li>Added combiner packing pipeline optimization to Dataflow runner. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-10641">BEAM-10641&lt;/a>)&lt;/li>
+&lt;li>Added an example to ingest data from Apache Kafka to Google Pub/Sub. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11065">BEAM-11065&lt;/a>)&lt;/li>
 &lt;/ul>
 &lt;h2 id="breaking-changes">Breaking Changes&lt;/h2>
 &lt;ul>
@@ -5333,55 +5402,4 @@ see the level of support for this new model feature on your favorite
 backend(s).&lt;/p>
 &lt;p>And please do join the community at
 &lt;a href="/get-started/support">user@beam.apache.org&lt;/a>. We&amp;rsquo;d love to
-hear from you.&lt;/p></description></item><item><title>Blog: Media recap of the Apache Beam graduation</title><link>/blog/graduation-media-recap/</link><pubDate>Wed, 01 Feb 2017 00:00:01 -0800</pubDate><guid>/blog/graduation-media-recap/</guid><description>
-&lt;!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-&lt;p>One year ago today Apache Beam was accepted into incubation at the Apache
-Software Foundation. The community&amp;rsquo;s work over the past year culminated, just
-over three weeks ago, with an &lt;a href="/blog/2017/01/10/beam-graduates.html">announcement&lt;/a>
-that Apache Beam has successfully graduated as a new Top-Level Project at the
-foundation. Graduation sparked an additional interest in the project, from
-corporate endorsements, news articles, interviews, to the volume of traffic to
-our website and mailing lists.&lt;/p>
-&lt;p>Corporate endorsements include Google, PayPal, Talend, data Artisans, and
-others. You can read more in the following blog posts:&lt;/p>
-&lt;ul>
-&lt;li>Google: &amp;ldquo;&lt;a href="https://opensource.googleblog.com/2017/01/apache-beam-graduates.html">Apache Beam graduates to a top-level project&lt;/a>&amp;rdquo; by Tyler Akidau.&lt;/li>
-&lt;li>Talend: &amp;ldquo;&lt;a href="https://www.talend.com/blog/2017/01/13/future-apache-beam-now-top-level-apache-software-foundation-project/">The Future of Apache Beam, Now a Top-Level Apache Software Foundation Project&lt;/a>&amp;rdquo; by Jean-Baptiste Onofré.&lt;/li>
-&lt;li>Talend: &amp;ldquo;&lt;a href="https://www.talend.com/blog/2017/01/23/apache-beam-way-greater-data-agility/?utm_medium=socialpost&amp;amp;utm_source=twitter&amp;amp;utm_campaign=blog">Apache Beam Your Way to Greater Data Agility&lt;/a>&amp;rdquo; by Shane Kent.&lt;/li>
-&lt;li>Google: &amp;ldquo;&lt;a href="https://cloud.google.com/blog/big-data/2017/01/apache-beam-graduates-from-incubation-try-it-today-on-google-cloud-dataflow">Apache Beam graduates from incubation: Try it today on Google Cloud Dataflow&lt;/a>&amp;rdquo; by Frances Perry.&lt;/li>
-&lt;/ul>
-&lt;p>News coverage started with the Apache Software Foundation’s press release in
-&lt;a href="https://globenewswire.com/news-release/2017/01/10/904692/0/en/The-Apache-Software-Foundation-Announces-Apache-Beam-as-a-Top-Level-Project.html">Nasdaq GlobeNewswire&lt;/a>,
-and followed by coverage in many independent outlets. Some of those in English
-include:&lt;/p>
-&lt;ul>
-&lt;li>ZDNet: &amp;ldquo;&lt;a href="https://www.zdnet.com/article/apache-beam-and-spark-new-coopetition-for-squashing-the-lambda-architecture/">Apache Beam and Spark: New coopetition for squashing the Lambda Architecture?&lt;/a>&amp;rdquo; by Tony Baer.&lt;/li>
-&lt;li>Datanami: &amp;ldquo;&lt;a href="https://www.datanami.com/2017/01/10/google-lauds-outside-influence-apache-beam/">Google Lauds Outside Influence on Apache Beam&lt;/a>&amp;rdquo; by Alex Woodie.&lt;/li>
-&lt;li>InfoWorld / JavaWorld: &amp;ldquo;&lt;a href="https://www.infoworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html">Apache Beam unifies batch and streaming for big data&lt;/a>&amp;rdquo; by Serdar Yegulalp, and republished in &lt;a href="https://www.javaworld.com/article/3156598/big-data/apache-beam-unifies-batch-and-streaming-for-big-data.html">JavaWorld&lt;/a>.&lt;/li>
-&lt;li>JAXenter: &amp;ldquo;&lt;a href="https://jaxenter.com/apache-beam-interview-131314.html">In a way, Apache Beam is the glue that connects many big data systems together&lt;/a>&amp;rdquo; by Kypriani Sinaris.&lt;/li>
-&lt;li>OStatic: &amp;ldquo;Apache Beam Unifies Batch and Streaming Data Processing&amp;rdquo; by Sam Dean. &lt;!-- http://ostatic.com/blog/apache-beam-unifies-batch-and-streaming-data-processing -->&lt;/li>
-&lt;li>Enterprise Apps Today: &amp;ldquo;&lt;a href="http://www.enterpriseappstoday.com/business-intelligence/data-analytics/apache-beam-graduates-to-help-define-streaming-data-processing.html">Apache Beam Graduates to Help Define Streaming Data Processing&lt;/a>&amp;rdquo; by Sean Michael Kerner.&lt;/li>
-&lt;li>The Register: &amp;ldquo;&lt;a href="https://www.theregister.co.uk/2017/01/10/google_must_be_ibeamiing_as_apache_announces_its_new_top_level_projects/">Google must be Beaming as Apache announces its new top-level projects&lt;/a>&amp;rdquo; by Alexander J. Martin.&lt;/li>
-&lt;li>SiliconANGLE: &amp;ldquo;&lt;a href="https://siliconangle.com/blog/2017/01/11/apache-software-foundation-announces-2-top-level-projects/">Apache Software Foundation announces two more top-level open source projects&lt;/a>&amp;rdquo; by Mike Wheatley.&lt;/li>
-&lt;li>SD Times: &amp;ldquo;&lt;a href="https://sdtimes.com/apache-beam-goes-top-level/">Apache Beam goes top level&lt;/a>&amp;rdquo; by Alex Handy.&lt;/li>
-&lt;/ul>
-&lt;p>Graduation and media coverage helped push Beam website traffic to record levels.
-The website traffic, measured in unique sessions per hour, peaked at more than
-15 times above the previous week’s numbers. In a steady state, the traffic is
-several times larger than before graduation.&lt;/p>
-&lt;p>Hopefully these perspectives entice you to join us on this exciting ride, either
-as a user or a contributor, as we work towards our first release with API
-stability. If you’d like to try out Apache Beam today, check out the latest
-&lt;a href="/get-started/downloads/">0.4.0 release&lt;/a>. We welcome
-contribution and participation from anyone through our mailing lists, issue
-tracker, pull requests, and events.&lt;/p></description></item></channel></rss>
\ No newline at end of file
+hear from you.&lt;/p></description></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/categories/index.xml b/website/generated-content/categories/index.xml
index b7fa3c8..ba87864 100644
--- a/website/generated-content/categories/index.xml
+++ b/website/generated-content/categories/index.xml
@@ -1 +1 @@
-<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Beam – Categories</title><link>/categories/</link><description>Recent content in Categories on Apache Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Thu, 07 Jan 2021 12:00:00 -0800</lastBuildDate><atom:link href="/categories/index.xml" rel="self" type="application/rss+xml"/></channel></rss>
\ No newline at end of file
+<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Beam – Categories</title><link>/categories/</link><description>Recent content in Categories on Apache Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Fri, 15 Jan 2021 00:00:01 -0800</lastBuildDate><atom:link href="/categories/index.xml" rel="self" type="application/rss+xml"/></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/categories/java/index.html b/website/generated-content/categories/java/index.html
new file mode 100644
index 0000000..c232ee2
--- /dev/null
+++ b/website/generated-content/categories/java/index.html
@@ -0,0 +1,7 @@
+<!doctype html><html lang=en class=no-js><head><meta charset=utf-8><meta http-equiv=x-ua-compatible content="IE=edge"><meta name=viewport content="width=device-width,initial-scale=1"><title>java</title><meta name=description content="Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Language [...]
+<span class=sr-only>Toggle navigation</span>
+<span class=icon-bar></span><span class=icon-bar></span><span class=icon-bar></span></button>
+<a href=/ class=navbar-brand><img alt=Brand style=height:25px src=/images/beam_logo_navbar.png></a></div><div class="navbar-mask closed"></div><div id=navbar class="navbar-container closed"><ul class="nav navbar-nav"><li><a href=/get-started/beam-overview/>Get Started</a></li><li><a href=/documentation/>Documentation</a></li><li><a href=/documentation/sdks/java/>Languages</a></li><li><a href=/documentation/runners/capability-matrix/>RUNNERS</a></li><li><a href=/roadmap/>Roadmap</a></li>< [...]
+<a href=http://www.apache.org>The Apache Software Foundation</a>
+| <a href=/privacy_policy>Privacy Policy</a>
+| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/categories/java/index.xml b/website/generated-content/categories/java/index.xml
new file mode 100644
index 0000000..1c5d82b
--- /dev/null
+++ b/website/generated-content/categories/java/index.xml
@@ -0,0 +1,69 @@
+<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Apache Beam – java</title><link>/categories/java/</link><description>Recent content in java on Apache Beam</description><generator>Hugo -- gohugo.io</generator><lastBuildDate>Fri, 15 Jan 2021 00:00:01 -0800</lastBuildDate><atom:link href="/categories/java/index.xml" rel="self" type="application/rss+xml"/><item><title>Blog: Example to ingest data from Apache Kafka to Google Cloud Pub/Sub</title><link>/blog/kafka-t [...]
+&lt;!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+&lt;p>In this blog post we present an example that creates a pipeline to read data from a single topic or
+multiple topics from &lt;a href="https://kafka.apache.org/">Apache Kafka&lt;/a> and write data into a topic
+in &lt;a href="https://cloud.google.com/pubsub">Google Pub/Sub&lt;/a>. The example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution that you can just &lt;em>&amp;rdquo;
+plug&amp;rsquo;n&amp;rsquo;play&amp;rdquo;&lt;/em>.&lt;/p>
+&lt;p>This end-to-end example is included
+in &lt;a href="https://beam.apache.org/blog/beam-2.27.0/">Apache Beam release 2.27&lt;/a>
+and can be downloaded &lt;a href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22">here&lt;/a>.&lt;/p>
+&lt;p>We hope you will find this example useful for setting up data pipelines between Kafka and Pub/Sub.&lt;/p>
+&lt;h1 id="example-specs">Example specs&lt;/h1>
+&lt;p>Supported data formats:&lt;/p>
+&lt;ul>
+&lt;li>Serializable plain text formats, such as JSON&lt;/li>
+&lt;li>&lt;a href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage">PubSubMessage&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported input source configurations:&lt;/p>
+&lt;ul>
+&lt;li>Single or multiple Apache Kafka bootstrap servers&lt;/li>
+&lt;li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL connection&lt;/li>
+&lt;li>Secrets vault service &lt;a href="https://www.vaultproject.io/">HashiCorp Vault&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported destination configuration:&lt;/p>
+&lt;ul>
+&lt;li>Single Google Pub/Sub topic&lt;/li>
+&lt;/ul>
+&lt;p>In a simple scenario, the example will create an Apache Beam pipeline that will read messages from a
+source Kafka server with a source topic, and stream the text messages into specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication, that can be performed
+over plaintext or SSL encrypted connection. The example supports using a single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets vault service with
+Kafka username and password, currently supporting HashiCorp Vault.&lt;/p>
+&lt;h1 id="where-can-i-run-this-example">Where can I run this example?&lt;/h1>
+&lt;p>There are two ways to execute the pipeline.&lt;/p>
+&lt;ol>
+&lt;li>Locally. This way has many options - run directly from your IntelliJ, or create &lt;code>.jar&lt;/code> file and
+run it in the terminal, or use your favourite method of running Beam pipelines.&lt;/li>
+&lt;li>In &lt;a href="https://cloud.google.com/">Google Cloud&lt;/a> using Google
+Cloud &lt;a href="https://cloud.google.com/dataflow">Dataflow&lt;/a>:
+&lt;ul>
+&lt;li>With &lt;code>gcloud&lt;/code> command-line tool you can create
+a &lt;a href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates">Flex Template&lt;/a>
+out of this Beam example and execute it in Google Cloud Platform. &lt;em>This requires corresponding
+modifications of the example to turn it into a template.&lt;/em>&lt;/li>
+&lt;li>This example exists as
+a &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub">Flex Template version&lt;/a>
+within &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates">Google Cloud Dataflow Template Pipelines&lt;/a>
+repository and can be run with no additional code modifications.&lt;/li>
+&lt;/ul>
+&lt;/li>
+&lt;/ol>
+&lt;h1 id="next-steps">Next Steps&lt;/h1>
+&lt;p>Give this &lt;strong>Beam end-to-end example&lt;/strong> a try. If you are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already using Beam, we hope
+some code samples in it will be useful for your use cases.&lt;/p>
+&lt;p>Please
+&lt;a href="https://beam.apache.org/community/contact-us/">let us know&lt;/a> if you encounter any issues.&lt;/p></description></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/feed.xml b/website/generated-content/feed.xml
index e89a4b0..837708f 100644
--- a/website/generated-content/feed.xml
+++ b/website/generated-content/feed.xml
@@ -1,4 +1,72 @@
-<rss xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title>Apache Beam</title><description>Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number [...]
+<rss xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title>Apache Beam</title><description>Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number [...]
+&lt;!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+http://www.apache.org/licenses/LICENSE-2.0
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+&lt;p>In this blog post we present an example that creates a pipeline to read data from a single topic or
+multiple topics from &lt;a href="https://kafka.apache.org/">Apache Kafka&lt;/a> and write data into a topic
+in &lt;a href="https://cloud.google.com/pubsub">Google Pub/Sub&lt;/a>. The example provides code samples to implement
+simple yet powerful pipelines and also provides an out-of-the-box solution that you can just &lt;em>&amp;rdquo;
+plug&amp;rsquo;n&amp;rsquo;play&amp;rdquo;&lt;/em>.&lt;/p>
+&lt;p>This end-to-end example is included
+in &lt;a href="https://beam.apache.org/blog/beam-2.27.0/">Apache Beam release 2.27&lt;/a>
+and can be downloaded &lt;a href="https://beam.apache.org/get-started/downloads/#2270-2020-12-22">here&lt;/a>.&lt;/p>
+&lt;p>We hope you will find this example useful for setting up data pipelines between Kafka and Pub/Sub.&lt;/p>
+&lt;h1 id="example-specs">Example specs&lt;/h1>
+&lt;p>Supported data formats:&lt;/p>
+&lt;ul>
+&lt;li>Serializable plain text formats, such as JSON&lt;/li>
+&lt;li>&lt;a href="https://cloud.google.com/pubsub/docs/reference/rest/v1/PubsubMessage">PubSubMessage&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported input source configurations:&lt;/p>
+&lt;ul>
+&lt;li>Single or multiple Apache Kafka bootstrap servers&lt;/li>
+&lt;li>Apache Kafka SASL/SCRAM authentication over plaintext or SSL connection&lt;/li>
+&lt;li>Secrets vault service &lt;a href="https://www.vaultproject.io/">HashiCorp Vault&lt;/a>&lt;/li>
+&lt;/ul>
+&lt;p>Supported destination configuration:&lt;/p>
+&lt;ul>
+&lt;li>Single Google Pub/Sub topic&lt;/li>
+&lt;/ul>
+&lt;p>In a simple scenario, the example will create an Apache Beam pipeline that will read messages from a
+source Kafka server with a source topic, and stream the text messages into specified Pub/Sub
+destination topic. Other scenarios may need Kafka SASL/SCRAM authentication, that can be performed
+over plaintext or SSL encrypted connection. The example supports using a single Kafka user account
+to authenticate in the provided source Kafka servers and topics. To support SASL authentication over
+SSL the example will need an SSL certificate location and access to a secrets vault service with
+Kafka username and password, currently supporting HashiCorp Vault.&lt;/p>
+&lt;h1 id="where-can-i-run-this-example">Where can I run this example?&lt;/h1>
+&lt;p>There are two ways to execute the pipeline.&lt;/p>
+&lt;ol>
+&lt;li>Locally. This way has many options - run directly from your IntelliJ, or create &lt;code>.jar&lt;/code> file and
+run it in the terminal, or use your favourite method of running Beam pipelines.&lt;/li>
+&lt;li>In &lt;a href="https://cloud.google.com/">Google Cloud&lt;/a> using Google
+Cloud &lt;a href="https://cloud.google.com/dataflow">Dataflow&lt;/a>:
+&lt;ul>
+&lt;li>With &lt;code>gcloud&lt;/code> command-line tool you can create
+a &lt;a href="https://cloud.google.com/dataflow/docs/concepts/dataflow-templates">Flex Template&lt;/a>
+out of this Beam example and execute it in Google Cloud Platform. &lt;em>This requires corresponding
+modifications of the example to turn it into a template.&lt;/em>&lt;/li>
+&lt;li>This example exists as
+a &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates/tree/master/v2/kafka-to-pubsub">Flex Template version&lt;/a>
+within &lt;a href="https://github.com/GoogleCloudPlatform/DataflowTemplates">Google Cloud Dataflow Template Pipelines&lt;/a>
+repository and can be run with no additional code modifications.&lt;/li>
+&lt;/ul>
+&lt;/li>
+&lt;/ol>
+&lt;h1 id="next-steps">Next Steps&lt;/h1>
+&lt;p>Give this &lt;strong>Beam end-to-end example&lt;/strong> a try. If you are new to Beam, we hope this example will give
+you more understanding on how pipelines work and look like. If you are already using Beam, we hope
+some code samples in it will be useful for your use cases.&lt;/p>
+&lt;p>Please
+&lt;a href="https://beam.apache.org/community/contact-us/">let us know&lt;/a> if you encounter any issues.&lt;/p></description><link>/blog/kafka-to-pubsub-example/</link><pubDate>Fri, 15 Jan 2021 00:00:01 -0800</pubDate><guid>/blog/kafka-to-pubsub-example/</guid><category>blog</category><category>java</category></item><item><title>Apache Beam 2.27.0</title><description>
 &lt;!--
 Licensed under the Apache License, Version 2.0 (the "License");
 you may not use this file except in compliance with the License.
@@ -32,6 +100,7 @@ For more information on changes in 2.27.0, check out the
 &lt;li>Added Cloud Bigtable Provider extension to Beam SQL (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11173">BEAM-11173&lt;/a>, &lt;a href="https://issues.apache.org/jira/browse/BEAM-11373">BEAM-11373&lt;/a>)&lt;/li>
 &lt;li>Added a schema provider for thrift data (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11338">BEAM-11338&lt;/a>)&lt;/li>
 &lt;li>Added combiner packing pipeline optimization to Dataflow runner. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-10641">BEAM-10641&lt;/a>)&lt;/li>
+&lt;li>Added an example to ingest data from Apache Kafka to Google Pub/Sub. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-11065">BEAM-11065&lt;/a>)&lt;/li>
 &lt;/ul>
 &lt;h2 id="breaking-changes">Breaking Changes&lt;/h2>
 &lt;ul>
@@ -901,60 +970,4 @@ while providing higher quality error messages.&lt;/p>
 &lt;p>Go play with the new &lt;code>performance_runtime_type_check&lt;/code> feature!&lt;/p>
 &lt;p>It&amp;rsquo;s in an experimental state so please
 &lt;a href="https://beam.apache.org/community/contact-us/">let us know&lt;/a>
-if you encounter any issues.&lt;/p></description><link>/blog/python-performance-runtime-type-checking/</link><pubDate>Fri, 21 Aug 2020 00:00:01 -0800</pubDate><guid>/blog/python-performance-runtime-type-checking/</guid><category>blog</category><category>python</category><category>typing</category></item><item><title>Apache Beam 2.23.0</title><description>
-&lt;!--
-Licensed under the Apache License, Version 2.0 (the "License");
-you may not use this file except in compliance with the License.
-You may obtain a copy of the License at
-http://www.apache.org/licenses/LICENSE-2.0
-Unless required by applicable law or agreed to in writing, software
-distributed under the License is distributed on an "AS IS" BASIS,
-WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
-See the License for the specific language governing permissions and
-limitations under the License.
--->
-&lt;p>We are happy to present the new 2.23.0 release of Apache Beam. This release includes both improvements and new functionality.
-See the &lt;a href="/get-started/downloads/#2230-2020-07-29">download page&lt;/a> for this release.&lt;/p>
-&lt;p>For more information on changes in 2.23.0, check out the
-&lt;a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&amp;amp;version=12347145">detailed release notes&lt;/a>.&lt;/p>
-&lt;h2 id="highlights">Highlights&lt;/h2>
-&lt;ul>
-&lt;li>Twister2 Runner (&lt;a href="https://issues.apache.org/jira/browse/BEAM-7304">BEAM-7304&lt;/a>).&lt;/li>
-&lt;li>Python 3.8 support (&lt;a href="https://issues.apache.org/jira/browse/BEAM-8494">BEAM-8494&lt;/a>).&lt;/li>
-&lt;/ul>
-&lt;h2 id="ios">I/Os&lt;/h2>
-&lt;ul>
-&lt;li>Support for reading from Snowflake added (Java) (&lt;a href="https://issues.apache.org/jira/browse/BEAM-9722">BEAM-9722&lt;/a>).&lt;/li>
-&lt;li>Support for writing to Splunk added (Java) (&lt;a href="https://issues.apache.org/jira/browse/BEAM-8596">BEAM-8596&lt;/a>).&lt;/li>
-&lt;li>Support for assume role added (Java) (&lt;a href="https://issues.apache.org/jira/browse/BEAM-10335">BEAM-10335&lt;/a>).&lt;/li>
-&lt;li>A new transform to read from BigQuery has been added: &lt;code>apache_beam.io.gcp.bigquery.ReadFromBigQuery&lt;/code>. This transform
-is experimental. It reads data from BigQuery by exporting data to Avro files, and reading those files. It also supports
-reading data by exporting to JSON files. This has small differences in behavior for Time and Date-related fields. See
-Pydoc for more information.&lt;/li>
-&lt;li>Add dispositions for SnowflakeIO.write (&lt;a href="https://issues.apache.org/jira/browse/BEAM-10343">BEAM-10343&lt;/a>)&lt;/li>
-&lt;/ul>
-&lt;h2 id="new-features--improvements">New Features / Improvements&lt;/h2>
-&lt;ul>
-&lt;li>Update Snowflake JDBC dependency and add application=beam to connection URL (&lt;a href="https://issues.apache.org/jira/browse/BEAM-10383">BEAM-10383&lt;/a>).&lt;/li>
-&lt;/ul>
-&lt;h2 id="breaking-changes">Breaking Changes&lt;/h2>
-&lt;ul>
-&lt;li>&lt;code>RowJson.RowJsonDeserializer&lt;/code>, &lt;code>JsonToRow&lt;/code>, and &lt;code>PubsubJsonTableProvider&lt;/code> now accept &amp;ldquo;implicit
-nulls&amp;rdquo; by default when deserializing JSON (Java) (&lt;a href="https://issues.apache.org/jira/browse/BEAM-10220">BEAM-10220&lt;/a>).
-Previously nulls could only be represented with explicit null values, as in
-&lt;code>{&amp;quot;foo&amp;quot;: &amp;quot;bar&amp;quot;, &amp;quot;baz&amp;quot;: null}&lt;/code>, whereas an implicit null like &lt;code>{&amp;quot;foo&amp;quot;: &amp;quot;bar&amp;quot;}&lt;/code> would raise an
-exception. Now both JSON strings will yield the same result by default. This behavior can be
-overridden with &lt;code>RowJson.RowJsonDeserializer#withNullBehavior&lt;/code>.&lt;/li>
-&lt;li>Fixed a bug in &lt;code>GroupIntoBatches&lt;/code> experimental transform in Python to actually group batches by key.
-This changes the output type for this transform (&lt;a href="https://issues.apache.org/jira/browse/BEAM-6696">BEAM-6696&lt;/a>).&lt;/li>
-&lt;/ul>
-&lt;h2 id="deprecations">Deprecations&lt;/h2>
-&lt;ul>
-&lt;li>Remove Gearpump runner. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-9999">BEAM-9999&lt;/a>)&lt;/li>
-&lt;li>Remove Apex runner. (&lt;a href="https://issues.apache.org/jira/browse/BEAM-9999">BEAM-9999&lt;/a>)&lt;/li>
-&lt;li>RedisIO.readAll() is deprecated and will be removed in 2 versions, users must use RedisIO.readKeyPatterns() as a replacement (&lt;a href="https://issues.apache.org/jira/browse/BEAM-9747">BEAM-9747&lt;/a>).&lt;/li>
-&lt;/ul>
-&lt;h2 id="known-issues">Known Issues&lt;/h2>
-&lt;h2 id="list-of-contributors">List of Contributors&lt;/h2>
-&lt;p>According to git shortlog, the following people contributed to the 2.23.0 release. Thank you to all contributors!&lt;/p>
-&lt;p>Aaron, Abhishek Yadav, Ahmet Altay, aiyangar, Aizhamal Nurmamat kyzy, Ajo Thomas, Akshay-Iyangar, Alan Pryor, Alex Amato, Alexey Romanenko, Allen Pradeep Xavier, Andrew Crites, Andrew Pilloud, Ankur Goenka, Anna Qin, Ashwin Ramaswami, bntnam, Borzoo Esmailloo, Boyuan Zhang, Brian Hulette, Brian Michalski, brucearctor, Chamikara Jayalath, chi-chi weng, Chuck Yang, Chun Yang, Colm O hEigeartaigh, Corvin Deboeser, Craig Chambers, Damian Gadomski, Damon Douglas, Daniel Oliveira, Darius [...]
\ No newline at end of file
+if you encounter any issues.&lt;/p></description><link>/blog/python-performance-runtime-type-checking/</link><pubDate>Fri, 21 Aug 2020 00:00:01 -0800</pubDate><guid>/blog/python-performance-runtime-type-checking/</guid><category>blog</category><category>python</category><category>typing</category></item></channel></rss>
\ No newline at end of file
diff --git a/website/generated-content/index.html b/website/generated-content/index.html
index 83393d9..a13cbf5 100644
--- a/website/generated-content/index.html
+++ b/website/generated-content/index.html
@@ -5,7 +5,7 @@
 <a class="button button--primary" href=/get-started/try-apache-beam/>Try Beam</a>
 <a class="button button--primary" href=/get-started/downloads/>Download Beam SDK 2.27.0</a></div><div class=hero__ctas><a class=button href=/get-started/quickstart-java/>Java Quickstart</a>
 <a class=button href=/get-started/quickstart-py/>Python Quickstart</a>
-<a class=button href=/get-started/quickstart-go/>Go Quickstart</a></div></div></div><div class=hero__cols__col><div class=hero__blog><div class=hero__blog__title>The latest from the blog</div><div class=hero__blog__cards><a class=hero__blog__cards__card href=/blog/beam-2.27.0/><div class=hero__blog__cards__card__title>Apache Beam 2.27.0</div><div class=hero__blog__cards__card__date>Jan 7, 2021</div></a><a class=hero__blog__cards__card href=/blog/dataframe-api-preview-available/><div clas [...]
+<a class=button href=/get-started/quickstart-go/>Go Quickstart</a></div></div></div><div class=hero__cols__col><div class=hero__blog><div class=hero__blog__title>The latest from the blog</div><div class=hero__blog__cards><a class=hero__blog__cards__card href=/blog/kafka-to-pubsub-example/><div class=hero__blog__cards__card__title>Example to ingest data from Apache Kafka to Google Cloud Pub/Sub</div><div class=hero__blog__cards__card__date>Jan 15, 2021</div></a><a class=hero__blog__cards_ [...]
 <a class="button button--primary" href=/get-started/downloads/>Download Beam SDK 2.27.0</a></div><div class=ctas__ctas><a class=button href=/get-started/quickstart-java/>Java Quickstart</a>
 <a class=button href=/get-started/quickstart-py/>Python Quickstart</a>
 <a class=button href=/get-started/quickstart-go/>Go Quickstart</a></div></div></div><footer class=footer><div class=footer__contained><div class=footer__cols><div class=footer__cols__col><div class=footer__cols__col__logo><img src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg class=footer__logo alt="Apache logo"></div></div><div class="footer__cols__col footer__cols__col--md"><div class=foo [...]
diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml
index 4347bdb..cc6607f 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.27.0/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-01-08T13:31:50-08:00</lastmod></url><url><loc>/blog/d [...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/categories/blog/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url><loc>/blog/kafka-to-pubsub-example/</loc><lastmod>2021-01-20T19:53:05+03:00</lastmod></url><url> [...]
\ No newline at end of file


Mime
View raw message