Issue with Temporary AWS Token Expiration During MySQL Shell dumpInstance to S3
Hello everyone,
I'm encountering an issue with MySQL Shell when using the util.dumpInstance() function to upload data directly to Amazon S3. Specifically, when I run:
mysqlsh -e "util.dumpInstance('$name',{'s3bucketName': '$bucket_name', 'threads': '7', 'bytesPerChunk': '2G'})"
the upload sometimes fails due to AWS temporary tokens expiring before the dump completes. Since AWS temporary tokens have a limited lifespan, this makes it difficult to reliably upload large dumps directly to S3.
It seems that MySQL Shell does not use AWS's official SDK, which would normally handle token renewal for IAM roles and temporary credentials automatically. Without SDK support, we're stuck with manual workarounds, which aren't ideal for long-running operations.
Has anyone found a way to manage or refresh these tokens during a dumpInstance operation to S3? Or is there any chance that Oracle plans to integrate AWS SDK support to make S3 interactions more compatible with temporary tokens and IAM roles?
Thanks in advance for any insights!
Subject
Views
Written By
Posted
Issue with Temporary AWS Token Expiration During MySQL Shell dumpInstance to S3
148
November 07, 2024 03:49AM
Sorry, only registered users may post in this forum.
Content reproduced on this site is the property of the respective copyright holders.
It is not reviewed in advance by Oracle and does not necessarily represent the opinion
of Oracle or any other party.