AWS Bedrock Runtime - token count - requestId #5879
Unanswered
agustinp93
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello!
My team is using
@aws-sdk/client-bedrock-runtime
and everything is working fine but we are missing metadata that is visible in other SDK's.We are using:
Request is based in this example: https://docs.aws.amazon.com/bedrock/latest/userguide/bedrock-runtime_example_bedrock-runtime_InvokeClaude_section.html
In the response we don't receive the token count of the request and response done to Bedrock:
metadata { httpStatusCode: 200, requestId: '########-####-####-####-#########', extendedRequestId: undefined, cfId: undefined, attempts: 1, totalRetryDelay: 0 }
I can see in the docs that other SDK like PHP do return headers in the response and the token count is one of them. I also saw them while doing requests from a React app. But in this scenario where we moved to a lambda to be able to collect large amounts of data before invoking Bedrock this metadata we need is missing.
I'm missing something in the request config? is a bug we need to report?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions