OpenETL documentation
Guides and reference for using, running, integrating and extending OpenETL.
OpenETL copies data from databases and event streams into warehouses, data lakes and other streams. Pipelines run on a schedule or continuously. OpenETL checks each stream's delivery guarantee before it runs.
Start with What is OpenETL?. Then follow the quickstart to run a pipeline on your computer.
Find your way
| If you want to | Start with |
|---|---|
| Learn what OpenETL is, in plain words | What is OpenETL? and Concepts |
| Run OpenETL for your team | Self-host |
| Diagnose failures or stale data | Troubleshoot a pipeline |
| Manage access or recover an installation | Access and Back up and restore |
| Build pipelines | Pipelines |
| Check on pipelines and the data they deliver | Use the console |
| Connect dbt, Spark, Flink, your alerts or your own code | Integrate |
| Write a connector | Build a connector |
| Look up a field, a command or a setting | Reference |
| Know how it works inside | Internals |
Choose and manage connectors covers official, community and private connectors. Each connector has its own versions and release schedule. Its documentation describes setup, configuration, supported modes and limits.
Official connector pages appear under Connectors on the docs site. Their source files are in openetl-connectors. For other packages, use the Docs link in the console.
Note
OpenETL is in alpha. The current release is 0.1.0-alpha. The pipeline format and the API can change between releases.