Comments (5)
Yep, some output from journalctl -eu kubelet
:
May 09 22:23:23 0b9252601962 kubelet[1182]: E0509 22:23:23.018605 1182 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "0b9252601962" not found
May 09 22:23:23 0b9252601962 kubelet[1182]: W0509 22:23:23.132950 1182 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
May 09 22:23:25 0b9252601962 kubelet[1182]: E0509 22:23:25.689124 1182 event.go:209] Unable to write event: 'Post https://172.17.0.2:6443/api/v1/namespaces/default/events: dial tcp 172.17.0.2:6443: getsockopt: connection refused' (may retry after sleeping)
May 09 22:23:25 0b9252601962 kubelet[1182]: E0509 22:23:25.689171 1182 event.go:144] Unable to write event '&v1.Event {TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"0b9252601962.152d19dbdd88901a", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64) (nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences []v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"0b9252601962", UID:"0b9252601962", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node 0b9252601962 status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"0b9252601962"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbeb4fac632e2a01a, ext:295113266, loc:(*time.Location)(0x5b9f020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbeb4fac632e2a01a, ext:295113266, loc:(*time.Location)(0x5b9f020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}' (retry limit exceeded!)
May 09 22:23:25 0b9252601962 kubelet[1182]: E0509 22:23:25.689370 1182 event.go:209] Unable to write event: 'Post https://172.17.0.2:6443/api/v1/namespaces/default/events: dial tcp 172.17.0.2:6443: getsockopt: connection refused' (may retry after sleeping)
May 09 22:23:26 0b9252601962 kubelet[1182]: E0509 22:23:26.429219 1182 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://172.17.0.2:6443/api/v1/pods?fieldSelector=spec.nodeName%3D0b9252601962&limit=500&resourceVersion=0: dial tcp 172.17.0.2:6443: getsockopt: connection refused
May 09 22:23:26 0b9252601962 kubelet[1182]: E0509 22:23:26.448023 1182 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://172.17.0.2:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 172.17.0.2:6443: getsockopt: connection refused
May 09 22:23:26 0b9252601962 kubelet[1182]: E0509 22:23:26.450937 1182 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://172.17.0.2:6443/api/v1/nodes?fieldSelector=metadata.name%3D0b9252601962&limit=500&resourceVersion=0: dial tcp 172.17.0.2:6443: getsockopt: connection refused
from ansible-role-kubernetes.
Well, digging deeper, at least locally, the problem was due to a docker-in-docker aufs
issueโyou can't store aufs volumes inside the host aufs volume directory, so you have to make sure /var/lib/docker
is a volume in the containing Docker container... see warning in http://jpetazzo.github.io/2015/09/03/do-not-use-docker-in-docker-for-ci/
from ansible-role-kubernetes.
Everything worked great after I added --volume=/var/lib/docker
to my docker run
command. We'll see if Travis CI is happy as well.
from ansible-role-kubernetes.
Well... it works locally :P โ Travis CI seems to hang.
from ansible-role-kubernetes.
Works now, it looks like it may have been related to the daemon needing a reload after changing the kubelet options.
from ansible-role-kubernetes.
Related Issues (20)
- Configure Flannel networking tasks fails on Ubuntu 20.04 HOT 6
- Can't install any K8s version other than 1.20
- No kubeconfig in ~/.kube HOT 5
- Execution issue with kubernetes version HOT 5
- Role failing on play "Configure Calico networking" HOT 3
- Fail to install on fresh OS HOT 11
- Upgrade to new kubernetes versions HOT 3
- APT ignores version pinning on Ubuntu HOT 4
- CI Currently broken - kubelet won't start in GitHub Actions HOT 18
- Support JoinConfiguration HOT 2
- kube-flannel-rbac.yml not found HOT 3
- Put a hold on packages HOT 2
- Could not find the requested service kubelet: host HOT 2
- User "system:anonymous" cannot get resource "configmaps" in API group HOT 4
- `kubernetes-join-command` not delegated to any host except master HOT 6
- Ubuntu 22.04 needs to Forward IPv4 and letting iptables see bridged traffic HOT 4
- memory, br_netfilter and iptables issues when installing on 2023-05-03 Raspbian 64-bit HOT 4
- Changes to the location of Linux packages for Kubernetes HOT 1
- ansible-lint and molecule/default HOT 1
- Each virtual machine has the same hostname after installation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ansible-role-kubernetes.