As a Senior Data Engineer, you will develop the infrastructure for our core compute and storage platform and integrations with external infrastructure and services. You will be responsible for deployment architecture and tooling to improve the productivity of data engineers and data scientists who use our product.
- Design and develop cluster management for core compute and storage platform
- Develop integrations for customer infrastructure and pipelines
- Develop features to improve the effectiveness of the product for data engineers and data scientists
- 5+ years of related experience
- Experience with C++, Go, Python or Scala
- Experience with containers and resource managers (e.g., Kubernetes, Mesos, YARN)
- Preferred: familiarity with MPI