a
$90,000 – $160,000 / year
AWSPython
Job description
- Evolve our AWS-based data platform, making decisions around architecture, reliability, performance, security, and cost.
- Work alongside engineers on complex technical problems, including hands-on implementation when needed.
- Develop and improve self-service capabilities for data pipelines, dataset discovery, access management, and data quality monitoring.
- Strengthen our Data Mesh implementation, including domain ownership, data contracts, access controls, and federated governance.
- Improve data quality, lineage, and observability through automation and platform-level controls.
- Work closely with Product, Analytics Engineering, Data Governance, and business stakeholders to understand problems and develop solutions.
- Integrate AI into existing engineering tools and workflows across Data Engineering and Analytics Engineering, improving how teams develop pipelines, build data models, test changes, review code, and troubleshoot failures.
- Build AI capabilities directly into the data platform, helping users discover and understand datasets, work with data using natural language, investigate issues, and complete tasks that previously required technical knowledge or manual steps.
- Strong software or data engineering background, with recent hands-on technical experience and the ability to contribute to complex engineering decisions.
- A product mindset, with the ability to understand business and user needs, challenge proposed solutions, and work effectively with Product and other stakeholders.
- Deep AWS expertise, particularly in designing, building, and operating production data platforms using services such as S3, Glue, Athena, IAM, MWAA and Lake Formation.
- Strong understanding of data lake and lakehouse architectures, including storage, processing, metadata, security, performance, and cost.
- Experience operating large-scale data platforms, troubleshooting production issues, and improving reliability and efficiency.
- Proficiency in Python and SQL, along with practical experience in infrastructure as code, CI/CD, testing, and software engineering best practices.
- Practical experience with Data Mesh principles, decentralized data ownership, self-service data infrastructure, and federated governance.
- Experience implementing data quality, data contracts, observability, and access controls within production data platforms.
- Strong communication and people leadership skills, with the ability to develop engineers, delegate responsibility, and build an effective, independent team.
Find more English Speaking Jobs in Germany on Arbeitnow
Job details & requirements
- Occupation
- Software Engineer
- Openings
- 1