Sr Data Engineer

What You'll Do

A Successful Senior Data Engineer will be working for “Data as An Asset Team” which delivers and support all First Advantage need for data, reporting, analytics and intelligence to recommend business solutions (geared by machine learning models) The Developer work side by side with product owners and project leads to ensure expected quality software is built to serve our FA customers. The Developer is expected to learn the business and technical components of an application and work with their peers to follow Agile software development methodologies. Grow your career in our dynamic and fast paced environment of diverse software platforms and challenging projects that shape the future of the banking industry.

Roles And Responsibilities

This role is for an ETL developer to design, develop, maintain, and test Data warehouse and Data Lake applications collaborating with the development team, testing team and business partners to ensure successful delivery and implementation of application Requirements.
Responsible for reviewing and understanding requirements and translating them into high-level including source to target mappings
Create and maintain optimal data pipeline for data warehouse and data lake
Identify, design and implement internal process improvements applicable both for On-Premises and Cloud Migrations: Automating manual processes, Optimizing data delivery, re-designing infrastructure for greater scalability.
Responsible for unit testing, debugging, and performance testing, with key focus on data accuracy and integrity
Responsible for development of job schedules that integrate with upstream and downstream systems Accountable for on-time delivery of all documentation that include data mapping, design, build, testing, and deployment

What You Will Need To Be Successful

Minimum of 5+ years and above into databricks programming with Pyspark and working experience with databricks CLI.
5 years of Proficiency in planning & delivery of robust enterprise-grade data engineering pipelines using Python, Apache Spark, ETL
Minimum of 5 years in Data Analysis
Familiar with source code control version such as GIT
Experience in Creating high-level Design Artifacts.
Ability to present technical concepts to senior level business stakeholders.
Analytical and problem-solving skills.
Impeccable Communication skills – verbal and written.
Should be a self-motivated worker.
Excellent interpersonal skills, positive attitude, team-player.
Willingness to learn and adapt to changes.
Strong time management and task prioritization

Desired Skills

Experience with Data warehouse, Data Mart and Data Lake Technologies.
Experience with cloud technology - Azure Databricks, Azure Synapse, Azure Data Explorer, Azure SQL Database, Azure Data Factory, Azure Logic Apps, and Azure Delta Lake.
Familiar with distributed data (structured, semi-structured, unstructured, streaming) processing techniques using Apache Spark, Hadoop, Hive, Kafka, and big data ecosystem technologies.
Experience integrating with API's
Minimum of 2+ years of Linux / shell scripting complementary
Prior experience of working with globally distributed teams
Agile driven development

We have great people here and are looking for more. Come join us!

Follow Us

Facebook
Instagram
LinkedIn
X
YouTube

Equal Employment Opportunities at First Advantage

First Advantage is an equal opportunity employer. We are committed to providing a workplace and recruitment process that is free from unlawful discrimination, harassment, and retaliation. Employment decisions at First Advantage are based solely on qualifications, merit, and business needs. We do not discriminate in any aspect of employment on the basis of race, color, national origin, ancestry, citizenship, religion, creed, sex, gender identity, gender expression, sexual orientation, marital or family status, pregnancy, age, physical or mental disability, medical condition, genetic information, veteran or military status, or any other characteristic protected by applicable law.