OKD (kernel issues (6.x)) #1874
Replies: 1 comment 2 replies
-
Correct, it needs to be fixed upstream, the fix land in Fedora and it would be picked up by FCOS and finally in OKD
You can build your own OS with downgraded kernel to mitigate this, but in general if its deemed stable for FCOS and passes k8s conformance tests this kernel is good enough for OKD. I suggest to file a Fedora bug so that it could be proposed as a critical enough for FCOS. |
Beta Was this translation helpful? Give feedback.
-
I appreciate how the fix will eventually make it's way into an OKD release, but they/we can't even reproduce this issue let alone implement a fix at the kernel level so I think the downgraded kernel option is our best bet. Can you point me in the direction of some documentation for this? Appreciate your help with this (as ever)... |
Beta Was this translation helpful? Give feedback.
-
|
See https://github.com/coreos/layering-examples and https://github.com/vrutkovs/custom-okd-os/ |
Beta Was this translation helpful? Give feedback.
-
We're running into https://bugzilla.kernel.org/show_bug.cgi?id=217572 and have been since OKD 4.12 I believe (currently running 4.14.0-0.okd-2023-11-14-101924).
We managed to mitigate the bug somewhat by migrating all of our persistent volumes away from xfs in favour of ext4. That move reduced the number of instances of this bug from 3 or 4 per day, down to a handful per week. This helped but clearly this is still a problem.
We're after ideas on how to either troubleshoot this issue or work around it. The idea of SCOS and a kernel more closely aligned with RHCOS makes sense, but a lot of the eco-system around SCOS doesn't feel ready yet (nvidia gpu driver containers for example).
The bug itself is almost certainly IO related but we're unable to reproduce it on demand.
Appreciate this isn't directly an OKD issue, but we need some ideas from an OKD perspective on where we can go from here...
Any bright ideas/thoughts?
Beta Was this translation helpful? Give feedback.
All reactions