Job Description:
We are seeking a highly skilled and experienced Cloud Data Engineer with a strong background in AWS data warehousing services and Big Data technologies. The ideal candidate will have deep expertise in building data pipelines, managing large-scale data platforms, and ensuring the seamless flow of data across systems. You will be responsible for developing, optimizing, and maintaining scalable data architectures to support analytics and data-driven decision-making.
Key Responsibilities:
• Design, implement, and maintain scalable data pipelines using AWS services like S3, Redshift, Athena, Glue, Lambda, RDS, EMR, and Kinesis.
• Build and maintain ETL processes using Talend, AWS Glue, or other ETL tools to transform and load data efficiently.
• Develop complex SQL queries, PL/SQL, and Stored Procedures for data extraction, transformation, and loading (ETL).
• Work extensively with Big Data technologies such as Hadoop and Spark (Scala/Python) to develop and manage data flows in batch, real-time, and streaming environments.
• Ensure the best practices in Data Warehousing and Data Governance are followed across projects.
• Collaborate with cross-functional teams to define data requirements and build scalable data models for analytics and reporting.
• Continuously optimize data workflows, ensuring the highest standards of performance, scalability, and reliability.
Must-Have Skills:
• 3+ years of experience with AWS data warehousing services (S3, Redshift, Athena, Glue, Lambda, RDS, EMR, Kinesis, App Flow, Step Functions).
• 3+ years of hands-on experience with ETL tools such as Talend or AWS Glue.
• 3+ years of experience in PL/SQL, Complex SQL tuning, Stored Procedures, and Data Warehousing best practices.
• 3+ years of experience working with Big Data technologies (Hadoop, Spark) using Scala or Python for batch, real-time, and streaming data flows.
Good-to-Have Skills:
• Experience with Python scripting.
• Familiarity with data ingestion from SAP sources to AWS.
• Strong understanding of Data Modeling and schema design.
• Experience with Databricks and Snowflake.
Why Join Us?
• Work on cutting-edge cloud technologies and Big Data platforms.
• Be part of a dynamic team that drives data-driven decision-making across the organization.
• Engage with large-scale data solutions in a highly collaborative and innovative environment.