SR. AWS PYSPARK DEVELOPER (ONSITE)

Job Summary

We are seeking an experienced Architect with 6 to 10 years of experience to join our team. The ideal candidate will have a strong background in Spark Optimization AWS IAM Big Data AWS EC2 Amazon S3 Apache Spark and Python. Additionally domain expertise in Cards and Payments is required. This role involves designing and optimizing big data solutions to drive our business forward.

Responsibilities

• Lead the design and implementation of big data solutions using Apache Spark and AWS services.
• Oversee the optimization of Spark jobs to ensure high performance and cost-efficiency.
• Provide expertise in AWS IAM to manage access and permissions securely.
• Utilize AWS EC2 and Amazon S3 for scalable storage and compute solutions.
• Implement data processing pipelines using Apache Spark and Python.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Ensure data security and compliance with industry standards in the Cards and Payments domain.
• Conduct performance tuning and troubleshooting of big data applications.
• Develop and maintain documentation for data architecture and processes.
• Mentor junior team members and provide technical guidance.
• Stay updated with the latest trends and technologies in big data and cloud computing.
• Contribute to the continuous improvement of data engineering practices within the organization.
• Drive innovation by exploring new tools and techniques to enhance data processing capabilities.

Qualifications

• Possess a strong background in Spark Optimization and AWS IAM.
• Demonstrate expertise in Big Data technologies and AWS EC2.
• Have hands-on experience with Amazon S3 and Apache Spark.
• Show proficiency in Python for data processing tasks.
• Exhibit domain knowledge in Cards and Payments.
• Have excellent problem-solving and analytical skills.
• Display strong communication and collaboration abilities.