Big Data Engineer

Job Title: Big Data Engineer/Developer
Location: Pune
Experience Range: 5–9 years
Tech Stack Must Have : Hadoop, Python, Spark, Unix, Oracle.
Good to Have : Apache NiFi, Ozone, Cloud technologies.
Job Overview Responsible for the analysis, design, development, and delivery of software solutions. This role involves defining requirements for new applications and customisations while adhering to MasterCard standards, processes, and best practices. The candidate will develop, customise, and test applications to integrate with MasterCard specifications and provide leadership, mentoring, and technical guidance to team members.
Key Responsibilities (Major Accountabilities) Solution Design & Development
Plan, design, and develop technical solutions to meet business requirements in alignment with MasterCard standards and best practices
Lead day-to-day system development and maintenance activities to meet service level agreements (SLAs)
Deliver high-quality, cost-effective, and innovative solutions with faster time-to-market Full SDLC Ownership
Take accountability for the full Software Development Life Cycle (SDLC), including:
Requirements documentation and use-case definition
System design and technical artefacts
Test strategy and test design
Performance benchmarking
Release and deployment planning
Contingency and rollback plans
Feasibility studies and effort estimation Production Support & Maintenance
Perform system maintenance and production incident management
Identify root causes and drive remediation
Participate in on-call support (pager rotation) Architecture & Technology Leadership
Select appropriate technical frameworks and delivery methodologies
Maintain solution and technology roadmaps
Contribute to defining standards, processes, and best practices
Research and evaluate emerging technologies and frameworks Innovation & Vendor Collaboration
Participate in Proof of Concepts (PoCs)
Support evaluation and selection of vendors, technologies, and frameworks
Collaborate with vendor teams for product support Knowledge Sharing & Mentoring
Conduct knowledge sessions (e.g., brownbag sessions)
Ensure knowledge transfer from vendors to internal teams
Mentor team members and provide technical training Quality & Process Excellence
Promote and follow Quality Assurance (QA) and Quality Control (QC) processes
Ensure adequate test coverage across:
Unit Testing
System/Integration Testing
Performance Testing
Conduct reviews throughout SDLC:
Requirements, Design, Code, and Security Reviews
Identify opportunities for process improvement and efficiency Team Coordination
Coordinate offshore development activities
Manage day-to-day team execution and delivery
Education
Bachelor’s degree in:
Information Systems
Information Technology
Computer Science
Engineering
Or equivalent work experience
Experience
4–6 years of relevant experience in software engineering.
Tech Stack - Must Have : Hadoop, Python, Spark, Unix, Oracle.
Good to Have : Apache NiFi, Ozone, Cloud technologies.
Experience in delivering secure solutions (Financial Services domain preferred)
Strong understanding of software engineering concepts and methodologies
Skills & Competencies Technical & Professional Skills
Strong understanding of software development practices and SDLC
Ability to work with multiple frameworks and technologies
Awareness of secure coding and financial domain standards Behavioural Competencies
High energy, detail-oriented, and proactive mindset
Strong ownership, initiative, and self-motivation
Ability to work effectively under pressure Communication & Collaboration
Strong verbal and written communication skills
Excellent interpersonal and stakeholder management skills
Ability to work in a matrix-based, geographically distributed team Learning Agility
Willingness to learn new technologies and take on challenges
Adaptability in a fast-paced, evolving environment
Additional Expectations
Demonstrate MasterCard core competencies
Actively contribute to team growth and organisational best practices