til.duyet.net
blog
Search…
til.duyet.net
🤪
Today I Learned
Data Engineering
☁
AWS
⚒
Tools
💻
Shell
env from ConfigMap or Secrets
☸
Kubernetes, Helm, Kustomize
🔄
Apache Airflow
🐳
Docker
Database
Google BigQuery
Apache Hive
AWS Redshift / Postgres
Presto
Programming
🍪
Rust
🐍
Python
👻
Golang
💎
Javascript / Typescript
✨
FE / React
Unix
Git - Pretty git branch graphs
Checking files in Docker build context
Bash get the directory of the current script
Vim
Find and replace
Miscellaneous
[Fig] Single machine and distributed system structure
Deploying Machine Learning Models at Scale
Bypass a Chrome certificate/HSTS error
Articles
Powered By GitBook
⚒
Tools
  • Dremio - The Data Lake Engine - https://www.dremio.com​
  • Apache Airflow - programmatically author, schedule and monitor workflows - https://airflow.apache.org​
  • Perfect - The New Standard in Dataflow Automation - https://www.prefect.io​
  • Flyte - Develop, execute, and monitor distributed workflows reliably at scale - https://github.com/lyft/flyte​
  • Amundsen - Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data - https://github.com/lyft/amundsen
​
Previous
Issues
Next - Data Engineering
Shell
Last modified 10mo ago
Copy link
Edit on GitHub