Documentation
Amazon S3 Transfer
Amazon S3 Transfer provides CME Group historic files to an Amazon S3 bucket daily for subscription orders and one-time transfers for historical orders. This service is scalable, traceable and manageable by admin users.
Configuration
Navigate to the Settings page, where you can select Data Delivery Destinations and select Add Delivery Destination to set up a new delivery location.
Users input their bucket name, optional subfolder name and optional nickname for the destination. Note, the bucket region must be AWS US East 1.
Once saved, paste the below policy into the S3 Bucket Policy section on their AWS account to start receiving files. Users can then test their configuration by clicking the Test Connection button to ensure the details are input correctly.
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowForeignS3Access",
"Effect": "Allow",
"Principal": {
"AWS": [
"arn:aws:iam::905418243502:role/venus-cmeprod-airflow-ecs- AirflowTaskRoleWithUserSe-VzZmh3EcAysc",
"arn:aws:iam::905418243502:role/dhx-managed-s3-access-role-cmeprod"
]
},
"Action": [
"s3:ListBucket",
"s3:GetBucketLocation",
"s3:PutObject"
],
"Resource": [
"arn:aws:s3:::{bucket_name}/*",
"arn:aws:s3:::{bucket_name}"
]
}
]
}
With the connection saved, go back to your Amazon S3 bucket and edit the bucket Permissions and Bucket Policy to reflect the newly generated S3 policy statement.
Paste the statement into your bucket policy and save the changes. You should now be set up to transfer data.
If you have any issues receiving the data, please verify the bucket ownership enforcement. This means all objects put into the bucket will be owned by the bucket owner. S3 buckets prior to 2023 may not have this setting applied by default and can be added with the below command or through the console:
aws s3api put-bucket-ownership-controls \ --bucket DOC-EXAMPLE-BUCKET \ --ownership-controls="Rules=[{ObjectOwnership=BucketOwnerEnforced}]"
or in the console under permissions:
