cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul Angus <>
Subject RE: [DISCUSS] CloudStack Kubernetes Service plugin
Date Wed, 25 Sep 2019 18:42:52 GMT
Hi Sven,

The cloudstack-kubernetes-provider is a plugin for Kubernetes which enables Kubernetes to
drive CloudStack actions, such as opening firewall ports.
The CloudStack Kubernetes service, enables end users to request say, a Kubernetes cluster
with 1 master and 4 workers (based on a user requested service offering).  CloudStack takes
care of the plumbing and configuration to get the base cluster operational.
Amadeus House, Floral Street, London  WC2E 9DPUK

-----Original Message-----
From: Sven Vogel <> 
Sent: 25 September 2019 19:18
To: dev <>
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Sounds interesting.

For me there are also some questions like Pierre.

If I understand it correctly all nodes inclusive the masters will be deployed from a core
os template?
What are the pvc or storage class backend which are available to the cluster nodes? (Local
storage from the core os vms?)

And now a little bit sorting… what’s the difference between… its a little confusing




Sven Vogel
Teamlead Platform

Brühl 24, D-04109 Leipzig
P +49 341 42649 - 99
F +49 341 42649 - 98

Dr. Erik Wende, Hendrik Schubert, Frank Richter
Registergericht: Leipzig HRB 9065

Zertifiziert nach:
ISO/IEC 27001:2013
DIN EN ISO 9001:2015
DIN ISO/IEC 20000-1:2011

ISAE 3402 Typ II Assessed

EWERK-Blog<> | LinkedIn<>
| Xing<> | Twitter<>
| Facebook<>

Mit Handelsregistereintragung vom 09.07.2019 ist die EWERK RZ GmbH auf die EWERK IT GmbH verschmolzen
und firmiert nun gemeinsam unter dem Namen: EWERK DIGITAL GmbH, für weitere Informationen
klicken Sie hier<>.

Auskünfte und Angebote per Mail sind freibleibend und unverbindlich.

Disclaimer Privacy:
Der Inhalt dieser E-Mail (einschließlich etwaiger beigefügter Dateien) ist vertraulich und
nur für den Empfänger bestimmt. Sollten Sie nicht der bestimmungsgemäße Empfänger sein,
ist Ihnen jegliche Offenlegung, Vervielfältigung, Weitergabe oder Nutzung des Inhalts untersagt.
Bitte informieren Sie in diesem Fall unverzüglich den Absender und löschen Sie die E-Mail
(einschließlich etwaiger beigefügter Dateien) von Ihrem System. Vielen Dank.

The contents of this e-mail (including any attachments) are confidential and may be legally
privileged. If you are not the intended recipient of this e-mail, any disclosure, copying,
distribution or use of its contents is strictly prohibited, and you should please notify the
sender immediately and then delete it (including any attachments) from your system. Thank

Am 25.09.2019 um 19:29 schrieb Paul Angus <<>>:

The FS is here:

I'll let Abhishek fill in any gaps between whats in the FS and your questions - it might be
good to comment on the FS so all of this gets captured.
The one thing I would add is that we see this as just the next iteration of the feature, not
the end goal.  So we would look to add functionality after it goes live, but we would also
welcome any others wishing to extend the functionality too...

Kind regards
Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue

-----Original Message-----
From: Pierre-Luc Dion <>
Sent: 25 September 2019 18:12
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Make sense for the proposed implementation, would it handle redundant master?
How would the k8s cluster would be created, using Rancher tools, kubectl or other?

so far, the small part I understand from MaaS, it could be very interesting to integrate it
to cloudstack in a way where it could be use to  scale Hypervisor host, specially KVM nodes.

On Wed, Sep 25, 2019 at 10:47 AM Paul Angus <>

The proposed implementation will create a master and n worker nodes.
It will also support (graceful) cluster resizing, the next step would be to enable the CloudStack
plugin for Kubernetes to allow Kubernetes to drive that scaling, so that you can scale with
demand rather than needing to oversize you environment to begin with.

I've been keeping MaaS in mind as way of doing baremetal Kubernetes along side VM based Kubernetes
clusters.  Interestingly a few people that I have spoken to have said that they prefer the
use of VMs, because whole servers as the unit of scale is often very wasteful, unless you
'share' them which has all sorts of security implications...
Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue

-----Original Message-----
From: Pierre-Luc Dion <>
Sent: 25 September 2019 15:31
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Paul,

Yeah, was bad timing for the CCCNA this year unfortunately :-(,  I'm not sure I'm curious
to see how cloudstack could become more "other Apache products friendly" but I don't have
particular use case compared to k8s integration. Has you are suggesting, would probably make
sense to use Helm to deploy any other application stack.

btw, we are still working on the Canonical MaaS integration, a bit more challenging than anticipated...

To get back to a *Kubernetes Service plugin*:
To me, as a user of cloudstack at the moment, If I deploy a k8s cluster, I need to deploy
monstrous instances for worker nodes.
which doesn't make sense if I'm a cloud consumer. So I think we need to solve something challenging:
a k8s service that would scale has needed while keeping in mind redundancy of worker nodes
without sacrifice on security. Is the worker node is part of the ongoing work or it's more
about offering a k8s master and api infrastructure to a user ?

An easy path would be some kind of shared worker nodes pool but that involve possible security
risk unless you would trust users that consume those workers.

On Wed, Sep 25, 2019 at 10:15 AM Paul Angus <>

Hi Pierre-Luc,

(we missed you at CCCNA!) How are you seeing CloudStack being more deployment friendly?  What
you do think that we could do on top of creating the Kubenetes Cluster to begin with?
[thinking out loud - we could pre-package Tiller to make it easier to deploy openWhisk via
Helm charts ? ]

Kind regards

Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue

-----Original Message-----
From: Pierre-Luc Dion <>
Sent: 25 September 2019 13:37
Subject: Re: [DISCUSS] CloudStack Kubernetes Service plugin

Hi Rohit, Nux,

Thanks Rohit for cloudstack-provider, that's exactly it ! :-D Nux, I agree with your opinion,
but there is a lot of interest for k8s and seams like a lot of organisations are moving to
container based infrastructures to standardized their deployment.

if we want to extent the discussion to function as a service, would you guys see a possibility
for us to be more aligned or more deployment friendly for Openwhisk ?


On Wed, Sep 25, 2019 at 6:54 AM Will Stevens <>

We see huge demand for K8s in our customer base. Just a note...

On Wed, Sep 25, 2019, 4:03 AM Nux! <> wrote:

Do you guys see high demand for K8s?
From where I'm looking it seems to be going the way of Openstack, loads of hype, overcomplicated,
near-impossible to upgrade.
Not sure if it's worth investing resources for this.


Sent from the Delta quadrant using Borg technology!

On 2019-09-24 07:41, Abhishek Kumar wrote:
Hi all,

I would like to propose developing a plugin for Kubernetes integration in CloudStack, can
be named CloudStack Kubernetes Service plugin.
I've written down an initial design document for it here,
Please review and provide your thoughts and suggestions.


Abhishek Kumar

Software Engineer

Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue


*Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal t 1.888.796.8364
ext. 1403




*Pierre-Luc Dion*Lead Cloud Architect | Architecte infonuagique principal t 1.888.796.8364
ext. 1403


View raw message