Simple, Fast and Extensible Data Movement

Sync data from any source to any destination with CloudQuery CLI.

Trusted by

Why CloudQuery?

CloudQuery is a completely new type of ELT platform designed for simplicity, performance and extensibility. Powered by our popular open source framework.

Performance

Native connectors result in a low memory footprint and increased performance. We use a columnar data streaming protocol based on gRPC and Apache Arrow, so we can move data quickly without persisting it in an intermediate datastore.

Simple & Portable

CloudQuery CLI and connectors have zero external dependencies and can run on any machine, locally, in the cloud or embedded inside an orchestrator.

Extensible and Open Source SDK

Write your own connectors in any language by utilizing the CloudQuery open source SDK powered by Apache Arrow. Get out-of-the-box scheduling, rate-limiting, transformation, documentation and much more.

Try CloudQuery today

# Get Bitly link clicks to be stored in the corresponding table
def resolve(
    self, client: Client, parent_resource: Resource
) -> Generator[Any, None, None]:
    link_stats = client.client.get_link_clicks(parent_resource.item["id"])
    return list(
        map(
            lambda x: {
                "link_id": parent_resource.item["id"],
                "date": x["date"],
                "clicks": x["clicks"],
            },
            link_stats,
        )
    )

Explore solutions

Centralize data from different sources and build custom solutions for a wide variety of use cases.