Cloud Storage Setup

Configure permissions so outputs from Bulk Refresh API and DataStreams can be uploaded to your cloud bucket.

Amazon S3

To upload outputs to your Amazon S3 bucket, set up access permissions for the Oxylabs uploader service.

  1. Open https://s3.console.aws.amazon.com/.
  2. Go to S3 > Storage > Bucket Name (create a bucket if needed).
  3. Open Permissions > Bucket policy.
  4. Download the bucket policy and replace YOUR_BUCKET_NAME with your bucket name.

This policy allows the service to write job output files and verify the destination bucket.

Google Cloud Storage

To upload outputs to your Google Cloud Storage bucket, add the uploader service account as a principal and assign the required roles.

  1. Add this Oxylabs service account as principal:
    oxylabs-datasets-uploader@oxyds-database-api-prod.iam.gserviceaccount.com
  2. Grant these roles: Storage Bucket Viewer and Storage Object User.