AWS aims to lower log analytics costs with new analytics engine for managed OpenSearch

AWS has launched a new analytics engine for Amazon OpenSearch Service optimized for log analytics, claiming up to 70% storage cost reduction. The engine stores data in Apache Parquet format, uses Apache Calcite for query optimization, routes analytical operations to Apache DataFusion and search predicates to Lucene, and supports SQL and PPL. It was motivated by AI and agentic workloads driving a 93% increase in log volumes, forcing enterprises to drop retention windows or sample logs. Analysts note potential benefits including longer retention, better compliance, and reduced observability tool sprawl, but warn that adoption requires standing up a new domain and migrating ingestion pipelines, and the lack of DSL support may force rewrites of dashboards and automation workflows.

Source: https://www.infoworld.com/article/4191707/aws-aims-to-lower-log-analytics-costs-with-new-analytics-engine-for-managed-opensearch.html. 8 Sync News only summarizes and links out; content copyright belongs to the authors and original sources.