Data Platform Engineers specialize in designing and implementing cloud platforms that enable development and data teams to work efficiently. They focus on providing expertise and ensuring consistency in infrastructure design, making it scalable, reliable, secure, and automated. By establishing best practices (such as CI/CD, security, and monitoring) and promoting their adoption, they create a foundation that can be leveraged across various teams. At Crystalloids, this role emphasizes bridging the gap between design, operations, and data engineering, with a strong focus on infrastructure as code (IaC), CI/CD pipelines, cloud platform optimization, and implementing robust processes for data quality monitoring, validation, and assurance. Are you an experienced data platform engineer skilled in designing scalable infrastructure, automating workflows, and integrating cloud-native solutions? If you bring expertise in cloud platforms, a deep understanding of data systems, and a passion for delivering innovative and consistent solutions, we would love to connect with you!

As a Data Platform Engineer, you will help our customers develop and optimise their cloud platforms, enabling seamless integration, scalability, and automation. By leveraging Google Cloud technologies, you will deliver solutions tailored to the unique needs of our clients and their business objectives. Reporting directly to stakeholders, your responsibilities will include:

PLAN:

• Design and maintain backlogs and sprint plans to optimize platform delivery cycles and maximize value.
• Establish team standards based on industry best practices and integrate them effectively into workflows and processes.

DO:

• Design and manage cloud infrastructure on GCP using Terraform.
• Automate provisioning and configuration management of infrastructure.
• Develop and refine CI/CD pipelines to enable efficient and seamless application deployment.

CHECK:

• Ensure platform reliability and performance by implementing advanced monitoring and alerting systems.
• Establish and track data quality checks to maintain data accuracy, consistency, and completeness.
• Address data quality issues quickly, collaborating with relevant teams to resolve discrepancies.
• Identify and mitigate platform bottlenecks and security vulnerabilities proactively.

ACT:

• Continuously improve infrastructure to enhance scalability, reliability, and security.
• Share expertise and guide teams on best practices for infrastructure design and cloud operations.
• Communicate results and recommendations effectively to stakeholders.