Comments (4)
If that log is complete then it appears that the BareMetalHost is not getting reconciled when the secret is updated.
The theory here is that the BareMetalHost controller should receive events when the secret changes (even though the name of the secret doesn't change, so the BareMetalHost resource itself is unmodified). We have that set up per the instructions in the Operator SDK user guide. We're calling SetControllerReference
to make the BareMetalHost the owner of the Secret, so that it should be matched by the OwnerType filter.
It's not obvious why this wouldn't be working.
from baremetal-operator.
There is even a test for this exact scenario: https://github.com/metal3-io/baremetal-operator/blob/master/pkg/controller/baremetalhost/baremetalhost_controller_test.go#L414-L444
To be sure, its not totally 1:1 as the test case has malformed credentials (missing fields), and the issue above is an actual BMC authentication failure however it is supposed to demonstrate that we are at least correctly watching the secret.
from baremetal-operator.
@yprokule I think it is worth validating -- when you say the credentials were fixed, I think everyone on this thread is assuming you updated the secret. When you say they were fixed, is there a chance instead the host BMC credentials themselves were updated to match the existing secret?
from baremetal-operator.
@yprokule I think it is worth validating -- when you say the credentials were fixed, I think everyone on this thread is assuming you updated the secret. When you say they were fixed, is there a chance instead the host BMC credentials themselves were updated to match the existing secret?
@alanmeadows - yes, I mean secret is updated. And we do watch changes to the secret. I patched credentials few times in a row(using both good and bad values) and there are records about it:
{"level":"info","ts":1558686473.3275928,"logger":"baremetalhost","msg":"Reconciling BareMetalHost","Request.Namespace":"openshift-machine-api","Request.Name":"openshift-worker-rhhi-node-3"}
{"level":"info","ts":1558686473.32766,"logger":"baremetalhost_ironic","msg":"ironic settings","endpoint":"http://localhost:6385/v1/","deployKernelURL":"http://172.22.0.1/images/ironic-python
-agent.kernel","deployRamdiskURL":"http://172.22.0.1/images/ironic-python-agent.initramfs"}
{"level":"info","ts":1558686473.3276753,"logger":"baremetalhost","msg":"registering and validating access to management controller","Request.Namespace":"openshift-machine-api","Request.Name"
:"openshift-worker-rhhi-node-3","provisioningState":"registering"}
{"level":"info","ts":1558686473.3276803,"logger":"baremetalhost_ironic","msg":"validating management access","host":"openshift-worker-rhhi-node-3"}
{"level":"info","ts":1558686473.349593,"logger":"baremetalhost_ironic","msg":"found existing node by ID","host":"openshift-worker-rhhi-node-3"}
{"level":"info","ts":1558686473.371224,"logger":"baremetalhost","msg":"stopping on host error","Request.Namespace":"openshift-machine-api","Request.Name":"openshift-worker-rhhi-node-3","pro$isioningState":"registering","message":"Failed to get power state for node 4e934982-47de-4825-8c8b-a57f51725905. Error: IPMI call failed: power status."}
...SNIP...
{"level":"info","ts":1558686487.1810665,"logger":"baremetalhost","msg":"Reconciling BareMetalHost","Request.Namespace":"openshift-machine-api","Request.Name":"openshift-worker-rhhi-node-3"}
{"level":"info","ts":1558686487.1811376,"logger":"baremetalhost_ironic","msg":"ironic settings","endpoint":"http://localhost:6385/v1/","deployKernelURL":"http://172.22.0.1/images/ironic-pyt$
on-agent.kernel","deployRamdiskURL":"http://172.22.0.1/images/ironic-python-agent.initramfs"}
{"level":"info","ts":1558686487.181154,"logger":"baremetalhost","msg":"registering and validating access to management controller","Request.Namespace":"openshift-machine-api","Request.Name"$
"openshift-worker-rhhi-node-3","provisioningState":"registering"}
{"level":"info","ts":1558686487.1811614,"logger":"baremetalhost_ironic","msg":"validating management access","host":"openshift-worker-rhhi-node-3"}
{"level":"info","ts":1558686487.203829,"logger":"baremetalhost_ironic","msg":"found existing node by ID","host":"openshift-worker-rhhi-node-3"}
{"level":"info","ts":1558686487.224387,"logger":"baremetalhost","msg":"stopping on host error","Request.Namespace":"openshift-machine-api","Request.Name":"openshift-worker-rhhi-node-3","pro$
isioningState":"registering","message":"Failed to get power state for node 4e934982-47de-4825-8c8b-a57f51725905. Error: IPMI call failed: power status."}
Also this time I tried with a older BMO version: 10dc1d6 (deployed with dev-scripts)
from baremetal-operator.
Related Issues (20)
- BMH is stuck in inspecting state HOT 6
- ironic-inspector container does not start HOT 3
- Support building for multiple architectures HOT 4
- Set image tag for release branches and tags HOT 10
- Detach annotation does not apply immediately HOT 6
- Add LLDP collection in bmh HOT 5
- Run BMO e2e with Kubevirt backed BareMetalHosts HOT 4
- [Flake] Etcd timeout -> leader election failure -> webhook down HOT 2
- Consider splitting `pkg/provisioner/*` into golang plugins. HOT 12
- Ironic takes up a lot of spaces with growing amount of servers HOT 4
- Make bootMACAddress optional HOT 2
- [flake] Docker restart fails in BMO e2e HOT 1
- All Metal3 Centos E2E main tests fail with #1685 HOT 3
- BMO should print why its sitting in reconcile loop more than once HOT 5
- Cant use "make install" and "make uninstall" to install or uninstll CRD HOT 2
- Bump BMO 0.6 release branch to Go 1.22 HOT 7
- Bump BMO 0.5 release branch to Go 1.22 HOT 4
- Add NUMA topology information to BMH status.hardware HOT 3
- Add support for UEFI HTTP boot HOT 2
- Add PCI address information to BMH status.hardwareData HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from baremetal-operator.