Data Platform Engineer

About the role

Camlin, which builds IoT devices and data science solutions in-house, is looking for an experienced Data Platform Engineer. You will design, build, operate and continuously improve the company's cloud-native data platform and data pipelines, working closely with data engineers, AI and analytics teams and platform stakeholders. The role follows Infrastructure as Code and DevOps best practices and involves selecting and adopting big data technologies and mentoring other engineers.

Key responsibilities

• Design, implement and support scalable data platform solutions on AWS.
• Develop and optimize data processing workloads using Apache Spark and Databricks.
• Build and maintain streaming data solutions using Apache Kafka and Amazon MSK.
• Manage cloud infrastructure with Infrastructure as Code, focusing on automation and repeatability.
• Develop and maintain CI/CD pipelines for reliable deployment of platform components and data workloads.
• Implement security best practices, including identity and access management controls.
• Design and support Disaster Recovery and business continuity strategies for critical services.
• Monitor platform health, performance and reliability, and collaborate with engineering teams to improve scalability, observability and operational excellence.

Required profile

• 3+ years of experience in Data Engineering or Data Platform engineering roles.
• Fluency in English, written and verbal.
• Desirable: Bachelor's degree in computer software engineering or equivalent; experience building SaaS applications and operating data platforms in production.

Required skills

• Strong knowledge of Apache Spark and experience with Databricks.
• Good knowledge of AWS services (S3, IAM, EC2, RDS, MSK).
• Strong understanding of Apache Kafka concepts, architecture and operations.
• Proficiency in Terraform and Python for automation and platform engineering.
• CI/CD pipelines with modern DevOps tools, disaster recovery and high availability concepts.
• Desirable: Datadog, secure software development principles, platform monitoring and capacity planning.