@awsrecentnews.bsky.social🆕 Amazon EMR adds native data quality checks in Spark via EMR Data Quality, catching issues early at no extra cost. It uses AWS Glue rules and supports Iceberg, Hudi, and Delta Lake, available in all AWS regions to validate data at any pipeline stage.
@awsnews.bsky.socialAmazon EMR now supports native data quality checks in Apache Spark jobs
Amazon EMR now validates data quality natively within Apache Spark jobs. Data engineering teams can catch quality issues inline before bad data reaches downstream systems, without building or mainta...
@awsrecentnews.bsky.social🆕 AWS now offers system-managed write protection for Apache Iceberg materialized views, ensuring only AWS Glue can update them, keeping results consistent and unaltered across engines. Available in all regions supporting Iceberg materialized views.
@awsnews.bsky.socialApache Iceberg materialized views now support system-managed write protection
Today, AWS announces system-managed materialized views for Apache Iceberg. Materialized views let you precompute an expensive query once and reuse the result across engines. Because this resul...
@awsrecentnews.bsky.social🆕 Amazon EMR Serverless now supports up to 1TB shuffle for terabyte-scale operations, removing previous 200 GB limits and enabling enterprise-grade Apache Spark workloads without cluster management, available in 18 regions.
@awsnews.bsky.socialServerless Storage on Amazon EMR Serverless now supports terabyte-scale shuffle
Amazon EMR Serverless now offers enhanced serverless storage capabilities with support for up to 1TB shuffle operations, raising the previous 200 GB per-job limit. Amazon EMR Serverless makes it simp...
@awsrecentnews.bsky.social🆕 Amazon EMR on EKS now supports Spark Connect for interactive Spark sessions, letting data engineers develop and debug in SageMaker and IDEs like Jupyter, with persistent contexts and IAM roles. Available from EMR 7.14 and emr-spark-8.1.0.
@awsnews.bsky.socialRun interactive workloads on Amazon EMR on EKS with Spark Connect
Amazon EMR on EKS now supports interactive Apache Spark sessions with Spark Connect. Data engineers and data scientists can develop and debug Apache Spark applications interactively fro...
@awsrecentnews.bsky.social🆕 AWS now supports Amazon EMR on EKS with IPv6 clusters, enabling big data frameworks like Spark and Flink to scale without IPv4 address limits. Available at no extra cost, this feature removes IPv4 workarounds and is accessible in all regions where both services are available.
@awsnews.bsky.socialAmazon EMR on EKS now supports IPv6 Amazon EKS clusters
Today, AWS announces that Amazon EMR on EKS now supports running workloads on IPv6 Amazon Elastic Kubernetes Service (Amazon EKS) clusters. Amazon EMR on EKS enables data platform and analytics teams to run open-source big ...
@awsrecentnews.bsky.social🆕 Amazon EMR 7.14 is now available with upgrades for Spark, Iceberg, and new features for EC2, EKS, and Serverless, including faster materialized views, Spark Connect, and increased storage limit to 1 TiB. Available globally. For details, see the release guide.
@awsrecentnews.bsky.social🆕 Amazon EMR extends 36-month support for Apache Spark 4.1, adding Apache Iceberg v3 features and fine-grained access control. Available globally on EC2, EKS, and Serverless. For more, check release notes and support policy.
@awsnews.bsky.socialAmazon EMR 7.14 is now available
Amazon EMR 7.14 is now available with new features across Amazon EMR on EC2, Amazon EMR on EKS, and Amazon EMR Serverless, along with version upgrades for additional applications. This release also upgrades Apache Spark to 3.5.8 and Apache Iceber...
@awsnews.bsky.socialAmazon EMR introduces Long Term Support with Apache Spark 4.1
Amazon EMR introduces Long Term Support (LTS) releases, starting with emr-spark-8.1.0 and Apache Spark 4.1. With LTS, designated versions of the AWS runtime for Apache Spark receive 36 months of support. Amazon EMR pr...
@awsrecentnews.bsky.social🆕 Amazon EMR extends support at no cost for migrating off older releases until June 30, 2027, for 5.36-6.15 and August 31, 2027 for 7.0-7.10, aiding customers in transitioning to current versions with no additional charge. Contact AWS Support for details.
@awsnews.bsky.socialAmazon EMR extends support at no additional cost for customers migrating off older releases
Amazon EMR now gives you more time, at no additional cost, to migrate off older releases before they reach end of support. If you are actively migrating, your workloads on eli...