3
vane
4y

Making distributed scheduler that queue and run tasks on containers or other executors in future and also pulls new tasks from defined git repositories.

Tasks are added based on simple yaml configuration.

Need that for my side projects that gather data from multiple sources from time to time.

k8s looks to heavy for that and airflow can’t be configured like I want it to be so I started writing my own on Monday.
Nearly finished poc version.

Comments
  • 0
    Sounds similar to a project I made before, when it comes to distributed stuff the complex simplicity is really beautiful
  • 0
    Sounds similar to a project I made before, when it comes to distributed stuff the complex simplicity is really beautiful
Add Comment