Job description
AWS Data Engineer (Active SC)
Full time/ perm
Our client is seeking Security Cleared AWS Data Engineers at all levels to design, build, and support scalable cloud-based data solutions. You will develop robust data pipelines, automate workflows, and deliver secure, high-performance data platforms using AWS-native technologies.
Key Responsibilities
• Develop and maintain data pipelines using Python, SQL, and Apache Airflow.
• Build and manage containerised data applications using Docker.
• Design and optimise solutions using AWS services including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
• Implement CI/CD pipelines using GitLab or similar tools.
• Monitor, troubleshoot, and improve data pipeline performance and reliability.
• Collaborate with cross-functional teams to deliver secure and scalable data platforms.
• Ensure adherence to data governance, security, and best practice standards.
Essential Skills
• Active Security Clearance
• Strong experience with Python and SQL.
• Hands-on experience with Apache Airflow and Docker.
• Proven experience with AWS data services, including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch.
• Experience with Git, GitLab, and CI/CD pipelines.
• Understanding of AWS security best practices, IAM, and RBAC.
Desirable Skills
• Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR.
• Knowledge of Terraform or CloudFormation.
• Experience in consultancy or client-facing environments.
Personal Attributes
• Strong problem-solving and troubleshooting skills.
• Excellent communication and stakeholder management abilities.
• Collaborative approach and experience working in Agile teams.
• Proactive mindset with a focus on continuous improvement.