Kinesis API's giving 404 while intializing worker from k8 pods using IRCA auth mechanism.

[kashyap2108]

Describe the bug

Inside worker.intialize() method when this method is called

streamDescription, err := w.kc.DescribeStream(context.TODO(), &kinesis.DescribeStreamInput{
		StreamName: &w.kclConfig.StreamName,
	})

We are Getting the following error while running from k8 pod.
failed to sign request: failed to retrieve credentials: failed to retrieve credentials, operation error STS: AssumeRoleWithWebIdentity, https response error StatusCode: 404

while running the worker from EC2 instance it's working fine.
we are using IRSA method for auth. mechanism from k8 pod.

Kinesis DescribeStream and ListShards Api's are failing and giving above error.

Reproduction steps

1.Try to run the worker from k8 pod which uses IRSA auth. mechanism.
...

Expected behavior

It should be able to use the Kinesis Stream APi's without any error.

Additional context

No response

[kashyap2108]

@liuqi @matt-royal @aramprice

[taoj-action]

@kashyap2108 Are you using IRSA? It shouldn't be too hard to login to the pod and run AWS CLI for Kinesis to figure it out. Most likely, it is a configuration issue.

"Before starting the setup, check your EKS cluster version. IRSA is available on Amazon EKS versions 1.14 or later. To use this feature, you need to update your existing cluster to version 1.14 or later."