Code Monkey home page Code Monkey logo

Comments (5)

geerlingguy avatar geerlingguy commented on May 27, 2024

Yep, some output from journalctl -eu kubelet:

May 09 22:23:23 0b9252601962 kubelet[1182]: E0509 22:23:23.018605    1182 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "0b9252601962" not found
May 09 22:23:23 0b9252601962 kubelet[1182]: W0509 22:23:23.132950    1182 cni.go:171] Unable to update cni config: No networks found in /etc/cni/net.d
May 09 22:23:25 0b9252601962 kubelet[1182]: E0509 22:23:25.689124    1182 event.go:209] Unable to write event: 'Post https://172.17.0.2:6443/api/v1/namespaces/default/events: dial tcp 172.17.0.2:6443: getsockopt: connection refused' (may retry after sleeping)
May 09 22:23:25 0b9252601962 kubelet[1182]: E0509 22:23:25.689171    1182 event.go:144] Unable to write event '&v1.Event {TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"0b9252601962.152d19dbdd88901a", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64) (nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences []v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"0b9252601962", UID:"0b9252601962", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node 0b9252601962 status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"0b9252601962"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbeb4fac632e2a01a, ext:295113266, loc:(*time.Location)(0x5b9f020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbeb4fac632e2a01a, ext:295113266, loc:(*time.Location)(0x5b9f020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}' (retry limit exceeded!)
May 09 22:23:25 0b9252601962 kubelet[1182]: E0509 22:23:25.689370    1182 event.go:209] Unable to write event: 'Post https://172.17.0.2:6443/api/v1/namespaces/default/events: dial tcp 172.17.0.2:6443: getsockopt: connection refused' (may retry after sleeping)
May 09 22:23:26 0b9252601962 kubelet[1182]: E0509 22:23:26.429219    1182 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://172.17.0.2:6443/api/v1/pods?fieldSelector=spec.nodeName%3D0b9252601962&limit=500&resourceVersion=0: dial tcp 172.17.0.2:6443: getsockopt: connection refused
May 09 22:23:26 0b9252601962 kubelet[1182]: E0509 22:23:26.448023    1182 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://172.17.0.2:6443/api/v1/services?limit=500&resourceVersion=0: dial tcp 172.17.0.2:6443: getsockopt: connection refused
May 09 22:23:26 0b9252601962 kubelet[1182]: E0509 22:23:26.450937    1182 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://172.17.0.2:6443/api/v1/nodes?fieldSelector=metadata.name%3D0b9252601962&limit=500&resourceVersion=0: dial tcp 172.17.0.2:6443: getsockopt: connection refused

from ansible-role-kubernetes.

geerlingguy avatar geerlingguy commented on May 27, 2024

Well, digging deeper, at least locally, the problem was due to a docker-in-docker aufs issueโ€”you can't store aufs volumes inside the host aufs volume directory, so you have to make sure /var/lib/docker is a volume in the containing Docker container... see warning in http://jpetazzo.github.io/2015/09/03/do-not-use-docker-in-docker-for-ci/

from ansible-role-kubernetes.

geerlingguy avatar geerlingguy commented on May 27, 2024

Everything worked great after I added --volume=/var/lib/docker to my docker run command. We'll see if Travis CI is happy as well.

from ansible-role-kubernetes.

geerlingguy avatar geerlingguy commented on May 27, 2024

Well... it works locally :P โ€” Travis CI seems to hang.

from ansible-role-kubernetes.

geerlingguy avatar geerlingguy commented on May 27, 2024

Works now, it looks like it may have been related to the daemon needing a reload after changing the kubelet options.

from ansible-role-kubernetes.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.