Event-driven transfers from AWS S3

Storage Transfer Service can listen to event notifications in AWS to automatically transfer data that has been added or updated in the source location, into a Cloud Storage bucket. Learn more about the benefits of event-driven transfers.

Event-driven transfers listen to Amazon S3 Event Notifications sent to Amazon SQS to know when objects in the source bucket have been modified or added. Object deletions are not detected; deleting an object at the source does not delete the associated object in the destination bucket.

Event-driven transfers always use a Cloud Storage bucket as the destination.

Before you begin

Follow the instructions to grant the required permissions on your destination Cloud Storage bucket:

• Configure access to a destination: Cloud Storage

Create an SQS queue

1. In the AWS console, go to the Simple Queue Service page.

2. Click Create queue.

3. Enter a Name for this queue.

4. In the Access policy section, select Advanced. A JSON object is displayed.

   Standard AWS regions

   {
     "Version": "2008-10-17",
     "Id": "\_\_default\_policy\_ID",
     "Statement": [
       {
         "Sid": "\_\_owner\_statement",
         "Effect": "Allow",
         "Principal": {
           "AWS": "01234567890"
         },
         "Action": [
           "SQS:*"
         ],
         "Resource": "arn:aws:sqs:us-west-2:01234567890:test"
       }
     ]
   }

   AWS GovCloud regions

   {
     "Version": "2008-10-17",
     "Id": "\_\_default\_policy\_ID",
     "Statement": [
       {
         "Sid": "\_\_owner\_statement",
         "Effect": "Allow",
         "Principal": {
           "AWS": "01234567890"
         },
         "Action": [
           "SQS:*"
         ],
         "Resource": "arn:aws-us-gov:sqs:us-gov-west-1:01234567890:test"
       }
     ]
   }

   Copy the values of AWS and Resource. These are unique for each project.

5. Paste your specific values of AWS and Resource from the previous step into the following JSON snippet:

   Standard AWS regions

   {
   "Version": "2012-10-17",
   "Id": "example-ID",
   "Statement": [
     {
       "Sid": "example-statement-ID",
       "Effect": "Allow",
       "Principal": {
         "Service": "s3.amazonaws.com"
       },
       "Action": "SQS:SendMessage",
       "Resource": "RESOURCE",
       "Condition": {
         "StringEquals": {
           "aws:SourceAccount": "AWS"
         },
         "ArnLike": {
           "aws:SourceArn": "arn:aws:s3:::S3_BUCKET_NAME"
         }
       }
     }
   ]
   }

   AWS GovCloud regions

   {
   "Version": "2012-10-17",
   "Id": "example-ID",
   "Statement": [
     {
       "Sid"