DEVOPSdigest

Voltron Data announced the release of Ibis 8.0.

Ibis is a Python dataframe API that allows developers to easily run code across a myriad of data platforms – allowing the right query engine for the job to be done.

The new release has its first dedicated streaming backends for Apache Flink and RisingWave, offering a variety of batch and now streaming execution engines unified with a single Python dataframe API.

“Finally developers can write code once and use it across local, batch, CPU, GPU and now real-time query engines. Ibis is leading the charge to break down the barriers between batch and stream processing execution engines. This is a big step toward a modular and composable data ecosystem across all paradigms,” said Josh Patterson, co-founder and CEO of Voltron Data.

Ibis is an independently governed open source project backed by Voltron Data and contributors across data platforms including Google, Starburst Data and RisingWave. With today’s release, users can run Ibis on 20 different query engines — ranging from DuckDB for smaller queries to BigQuery, Spark, Theseus and others for big distributed preprocessing/ETL jobs. With no code change, they can also run on two streaming engines – Apache Flink and RisingWave.

“As the Ibis API improves and adds new functionality like ML preprocessing, every backend it supports improves with it. Users can learn a single familiar dataframe API without being locked into any backend. The open source community can add Ibis ecosystem integrations to make working with data in Python better on any data platform Ibis supports,” said Zhenzhong “Z” Xu, VP of Engineering at Voltron Data.