Data Management Integrations
| Integration | Description |
|---|---|
| Airbyte | Data integration platform specialising in ELT pipelines. |
| Airflow | Platform designed for developing, scheduling, and monitoring batch-oriented workflows. |
| Connect | Declarative data-agnostic streaming service for efficient, stateless processing. |
| Confluent | Fully-managed data streaming platform with a cloud-native Apache Kafka engine. |
| DLT | Python library to simplify data loading processes between several sources and destinations. |
| Fluvio | Rust-based platform for high speed, real-time data processing. |
| Fondant | Framework for developing datasets, sharing reusable operations and data processing trees. |
| MindsDB | Platform to deploy, serve, and fine-tune models with numerous data source integrations. |
| NiFi | Data ingestion platform to manage data transfer between different sources and destination systems. |
| Spark | A unified analytics engine for large-scale data processing. |
| Unstructured | Python library with components for ingesting and pre-processing data from numerous sources. |