Excess error logs upon termination

[hhamalai]

Description

Observed Behavior:
Occasionally Karpenter will print logs with log.level error during shutdown due to context cancellation, e.g.,

getting messages from queue, receiving sqs messages, RequestCanceled: request context canceled
caused by: context canceled

Expected Behavior:

Normal operations should not produce error logs. On the other hand, there might be issues where the context is cancelled due to network timeouts, so simply omitting errors here is not a likely option.

Reproduction Steps (Please include YAML):

Versions:

• Chart Version: 0.36.1

• Kubernetes Version (kubectl version): v1.30.1

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

[njtran]

It makes sense to me that we would emit this log on shutdown. What logs are you trying to not emit that are being emitted? Is it just the shutdown logs?