manifest: Minimize host;etcd/flannel/kube/storage as layers/containers

[cgwalters]

🚧 Do not merge 🚧 - pushing for comments/early review.

[cgwalters]

Pushing to share, not yet for merge 🚧

[cgwalters]

TL;DR architecture proposal:

• kubelet/kube-proxy via RPM
• etcd/flannel via system containers
• master/apiserver/scheduler etc. via Docker
• ceph/gluster either via RPM or containers (TBD)

Collection of links/work on cluster bootstrap:

kubelet (as layered RPM package):

• rpm-ostree pkg-add kubernetes-node

etcd/flannel (as system containers):

• https://github.com/yuqi-zhang/atomic-system-containers-quickstart

kubernetes

• https://jebpages.com/2016/08/15/running-kubernetes-in-containers-on-atomic/
• https://access.redhat.com/documentation/en/red-hat-enterprise-linux-atomic-host/version-7/getting-started-with-containers/#creating_a_kubernetes_cluster_to_run_docker_formatted_container_images
• http://kubernetes.io/docs/getting-started-guides/scratch/#configuring-and-installing-base-software-on-nodes

Storage:

• rpm-ostree pkg-add ceph-common glusterfs

[miabbott]

Is there related story/docs for containerized ceph/gluster?

[cgwalters]

Yeah, storage 📁 is another thread, thanks for bringing that up. I did verify that pkg-add works to re-add the packages we have now. Will edit the above comment.

[jasonbrooks]

Will we build/deliver the containers from: https://wiki.centos.org/ContainerPipeline

[cgwalters]

Yeah we should. There are some in fedora-cloud/Fedora-Dockerfiles#112 which we either need to progress or fork into centos or so.

[cgwalters]

There's still a number of open design items - we could e.g. bake in kubelet rather than layer via RPM. Some users may choose layered packages over syscontainers. We'll see. Let's move forward with this for now in Alpha and build on it.