kube-cluster-ansible

Table of Contents

• Overview
• Requrements
• Installation
• Verification
  • Kubernetes Dashboard
  • Monitoring Grafana
  • Kibana Logging
• Notes

Overview

Kubernetes v1.5.1 cluster deployment bundle including the following:

heapster dashboard with basic authentication enabled, influxdb and grafana for monitoring events and fluentd - elasticsearch - kibana for cluster log management.

tested on CentOS 7 and Ubuntu16.04 behind http-proxy.

credits: Installing Kubernetes on Linux with kubeadm, easy-cube, ansible.

Requrements

Ansible (tested on 2.1.2.0)

Installation

Setup 1 vanilla machine with your chosen provider.

• Copy your public ssh key on your machine user's ~/.ssh authorized_keys folder

• If you are on CentOS is required to disable SELinux by running setenforce 0 You have to do this until kubelet can handle SELinux better.

• In the inventory file fill the Hostname, username. If the machine has not a valid hostname set kubes_advertise_ip with the machine IP.

• Set usernames and passwords here for kubernetes-proxy https-service authentication (future provision for internal Oauth2 provider).

• If your want to alter the default settings e.g. adding a proxy or selecting your favorite network provider: defaults

Now you can provision your K8s cluster running on the project root:

ansible-playbook playbooks/deploy-cluster.yml

*For testing the solution on a local Vagrant just run:

vagrant up

NOTE: local Vagrant machine needs 4096 MB available RAM

Verification

To check if everything has provisioned correctly, on your master node, invoke:

kubectl get nodes

This will output all the nodes connected in the cluster:

NAME                 STATUS    AGE
kube-node-1          Ready     24m

To check the pod network is running correctly, invoke:

watch -d kubectl get pods --all-namespaces

You should finally see:

NAMESPACE     NAME                                       READY     STATUS    RESTARTS   AGE
kube-system   dummy-2088944543-m5vvc                     1/1       Running   0          27m
kube-system   elasticsearch-logging-v1-7xrw6             1/1       Running   0          27m
kube-system   elasticsearch-logging-v1-f4hql             1/1       Running   0          27m
kube-system   etcd-cluster.thema.io                      1/1       Running   0          27m
kube-system   fluentd-es-v1.20-jf0k8                     1/1       Running   0          27m
kube-system   heapster-2193675300-kwgpd                  1/1       Running   0          27m
kube-system   kibana-logging-3953273462-9qg8f            1/1       Running   0          27m
kube-system   kube-apiserver-cluster.thema.io            1/1       Running   1          27m
kube-system   kube-controller-manager-cluster.thema.io   1/1       Running   0          27m
kube-system   kube-discovery-1769846148-ctgz4            1/1       Running   0          27m
kube-system   kube-dns-2924299975-ww6d5                  4/4       Running   0          27m
kube-system   kube-proxy-twb20                           1/1       Running   0          27m
kube-system   kube-scheduler-cluster.thema.io            1/1       Running   0          27m
kube-system   kubernetes-dashboard-3095304083-lzr79      1/1       Running   0          27m
kube-system   monitoring-grafana-838819444-7bjxb         1/1       Running   0          27m
kube-system   monitoring-influxdb-1353739890-mhb88       1/1       Running   0          27m
kube-system   weave-net-65xpt                            2/2       Running   0          27m

Kubernetes Dashboard

Kubernetes dashboard heapster enabled, with event and live PM. In the prob asking for username/password enter one from here

https://172.28.128.159:6443/api/v1/proxy/namespaces/kube-system/services/kubernetes-dashboard/#/deployment?namespace=_all

Monitoring Grafana

Grafana connected with influxdb for performance monitoring.

https://172.28.128.159:6443/api/v1/proxy/namespaces/kube-system/services/monitoring-grafana

Kibana Logging

Kibana connected with elastic-search for log searching.

https://172.28.128.159:6443/api/v1/proxy/namespaces/kube-system/services/kibana-logging

Notes:

• Not tested using nodes (minions) yet, except master as minion. (to be continued)
• On a relative slow connection it will need about 20 minutes for downloading all docker images.
• If you want to access k8s cluster securely copy the /etc/kubernetes/kubelet.conf file from master node to ~/.kube/config on your local machine (of course you need to install kubectl locally), then you can access your cluster with kubectl proxy