> For the complete documentation index, see [llms.txt](https://til.duyet.net/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://til.duyet.net/data-engineering/tools.md).

# Tools

* Dremio - *The Data Lake Engine* - [https://www.dremio.com](https://www.dremio.com/)
* Apache Airflow ***-** programmatically author, schedule and monitor workflows **-*** [https://airflow.apache.org](https://airflow.apache.org/)
* Perfect - *The New Standard in Dataflow Automation* - [https://www.prefect.io](https://www.prefect.io/)
* Flyte - *Develop, execute, and monitor distributed workflows reliably at scale* - <https://github.com/lyft/flyte>
* Amundsen - *Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data* - <https://github.com/lyft/amundsen>