Why did you choose Glue for the project, given that there are other services available?

Glue was chosen because it offers a fully managed, serverless ETL platform that automatically discovers schemas, generates code, and integrates seamlessly with other AWS services such as S3, Redshift, and Athena. It eliminates the need to provision and maintain servers, reduces operational overhead, and scales on demand. Glue’s built‑in job scheduling and triggers simplify pipeline orchestration, and its integration with the Glue Data Catalog provides a single source of truth for metadata. These features make Glue an attractive choice for projects that require rapid development, cost efficiency, and tight integration with the AWS ecosystem.