> For the complete documentation index, see [llms.txt](https://til.duyet.net/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://til.duyet.net/data-engineering/aws/emr/s3-dist-cp.md).

# S3 Dist CP

```
s3-dist-cp -Dmapreduce.job.reduces=100 \
    -Dfs.s3a.access.key=yourAccessKey \
    -Dfs.s3a.secret.key=yourSecretKey\
    -Dmapreduce.reduce.maxattempts=3 \
    --outputManifest manifest-checkpoint.gz \
    --s3Endpoint=s3.us-east-1.amazonaws.com --src=s3a://source_s3/ --dest=s3a://dest_s3/
```

`yourAccessKey` and `yourSecretKey` should have access to both S3 source and destination.

References: <https://docs.aws.amazon.com/emr/latest/ReleaseGuide/UsingEMR_s3distcp.html>