All News

CloudQuery Centralizes Cloud Visibility with SQL Governance

Enterprises struggle with fragmented cloud visibility, juggling separate tools for security, cost, and asset inventory. CloudQuery centralizes data from over 60 sources — AWS, Azure, GCP, Okta, Wiz — into a unified, SQL-queryable warehouse. Leveraging high-frequency syncs, ClickHouse, and Apache Arrow, it maintains fresh, accurate metadata. Firms like Hexagon built fully serverless data lakes, cutting costs and complexity with this approach.

Published June 12, 2025 at 12:14 AM EDT in Cloud Infrastructure

Enterprise Cloud Visibility: The Challenge

Gaining visibility across sprawling enterprise cloud estates has never been more critical — or more difficult. Siloed tools for security, cost, and asset inventory force teams to stitch together multiple dashboards and APIs just to answer basic questions about their infrastructure.

CloudQuery's Unified Developer-First Platform

CloudQuery breaks down these silos by centralizing cloud assets, security metadata, and cost data in one place. Developers and cloud engineers can run built-in SQL queries against a single, normalized data warehouse to get real-time answers without juggling multiple vendor tools.

By pulling configuration, security, and billing metadata from over 60 platforms — including AWS, Azure, GCP, Okta, and Wiz — CloudQuery ensures you have a comprehensive view of your cloud environment. This approach accelerates troubleshooting and supports compliance, cost optimization, and security posture management.

High-Performance Architecture Under the Hood

At its core, CloudQuery leverages ClickHouse as its data warehouse and Apache Arrow for efficient in-memory analytics. A high-performance plugin architecture written in Go connects directly to cloud APIs, continuously syncing metadata into a relational structure that powers its SQL engine and interactive reports.

CloudQuery places a strong emphasis on data accuracy and freshness. High-frequency syncs ensure teams are working with reliable, up-to-date information — essential for preventing misconfigurations and responding swiftly to security threats or unexpected cost spikes.

While CloudQuery remains rooted in transparent, structured metadata, it also integrates large language models selectively for natural language querying, SQL generation, and tailored recommendations. This hybrid model drives flexibility without sacrificing trust in the underlying data.

Hexagon's Serverless Data Lake Success

Hexagon’s cloud center of excellence built a fully serverless data lake with CloudQuery. Data from all cloud accounts streams into S3, is ingested by AWS Glue, and becomes queryable in Amazon Athena and AWS QuickSight—all without standing up servers or manual maintenance.

Early feedback from Hexagon drove new CloudQuery features: Parquet file support to replace error-prone JSON, built-in data partitioning for efficient queries, and an Athena-compatible resource view function for seamless integration.

The result? An ultra-low-cost pipeline powered by S3, ECS, Glue, Athena, and Lambda. Hexagon unified IP address inventories across providers, slashed maintenance overhead, and gained instant visibility into resource ownership.

Actionable Insights for Your Cloud Engineers

Adopt a developer-first mindset, centralize multi-cloud metadata, and leverage SQL to ask tough questions—like finding unattached EBS volumes on idle instances—in seconds. Integrate security, cost, and compliance data in a single pane to move faster and reduce risk.

Is your team ready to break down cloud data silos and gain real-time insights? With unified governance, you’ll catch issues earlier, optimize spending, and build more securely.

Keep Reading

View All
The Future of Business is AI

AI Tools Built for Agencies That Move Fast.

Empower your team with QuarkyByte’s deep dives into cloud governance best practices like CloudQuery’s SQL-based model. Access step-by-step guides for centralizing multi-cloud assets and metadata. See real-world metrics on cost savings and security improvements.