Upgrade the project to support AWS Glue 5.0, which includes Spark 3.5 with ZGC (Z Garbage Collector) to reduce latency and improve performance.
Benefits:
• Reduced latency through ZGC implementation
• Improved performance with Spark 3.5
• Access to latest Glue features and optimizations
Java 17 updates
[Scala] Upgrade AWS SDK calls from v1 to v2
Upgrade the project to support AWS Glue 5.0, which includes Spark 3.5 with ZGC (Z Garbage Collector) to reduce latency and improve performance.
Benefits:
• Reduced latency through ZGC implementation
• Improved performance with Spark 3.5
• Access to latest Glue features and optimizations
Java 17 updates
[Scala] Upgrade AWS SDK calls from v1 to v2