MySQL Forums
Forum List  »  MySQL Shell

Issue with Temporary AWS Token Expiration During MySQL Shell dumpInstance to S3
Posted by: Dmitry Shorokhov
Date: November 07, 2024 03:49AM

Hello everyone,

I'm encountering an issue with MySQL Shell when using the util.dumpInstance() function to upload data directly to Amazon S3. Specifically, when I run:

mysqlsh -e "util.dumpInstance('$name',{'s3bucketName': '$bucket_name', 'threads': '7', 'bytesPerChunk': '2G'})"

the upload sometimes fails due to AWS temporary tokens expiring before the dump completes. Since AWS temporary tokens have a limited lifespan, this makes it difficult to reliably upload large dumps directly to S3.

It seems that MySQL Shell does not use AWS's official SDK, which would normally handle token renewal for IAM roles and temporary credentials automatically. Without SDK support, we're stuck with manual workarounds, which aren't ideal for long-running operations.

Has anyone found a way to manage or refresh these tokens during a dumpInstance operation to S3? Or is there any chance that Oracle plans to integrate AWS SDK support to make S3 interactions more compatible with temporary tokens and IAM roles?

Thanks in advance for any insights!

Options: ReplyQuote


Subject
Views
Written By
Posted
Issue with Temporary AWS Token Expiration During MySQL Shell dumpInstance to S3
148
November 07, 2024 03:49AM


Sorry, only registered users may post in this forum.

Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.