Apache Amaterasu (Incubating) is an open source, configuration managment and deployment framework for data pipelines

Find Out More

A new approach

Amaterasu is a simple and powerful framework to build, configure and dispense data processing pipelines. It aims to help data engineers and data scientists to compose, configure, test, package, deploy and execute data pipelines written using multiple tools, languages and frameworks

Get Started!


Simple to code

Code your data apps using the languages and frameworks of your choice.

Configuration managment

Configure your apps and frameworks using a powerful YAML DSL for multiple environments.

Ship your code

Amaterasu uses Git for applications and configurations repositories

Easy to deploy

Deploy and run in a single line!


Apache Amaterasu is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.

Copyright © 2017 The Apache Software Foundation
Apache, Apache Amaterasu (incubating), the Apache feather and the Gobblin logo are trademarks of The Apache Software Foundation