Hello, I'd like to get some help on compaction OOM in Spark. Calling rewrite_data_files on a relatively large partition in an AWS Glue 5.0 (Spark 3.5.4 and Iceberg 1. ...
We have an OpenSource Java application that uses the S3TransferManager and S3CrtAsyncClient, the OpenSearch Migration Assistant. We have observed some OutOfMemoryErrors when downloading s3 directories ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback