Senior Data Engineer
Aditi Consulting · Hyderabad, Telangana, India
Part-time · Senior · Posted 13 days ago
Summary:
The role will serve the Data Strategy and Operations function within Company, establishing new data integration patterns into Data 360 from third-party vendors and managing ingestion from existing sources. The individual will own pipeline monitoring, KPI tracking, and egress management to multiple downstream destinations.
Responsibilities:
Manage all new data ingestions for operational needs.
Build new data integrations for all new data sources and providers, including third-party data providers.
Manage new data egress patterns to send/share data outputs from Data 360 to multiple destinations.
Ingest new data via existing ingestion pipelines.
Monitor, maintain, and troubleshoot data pipelines.
Track and report statistics including data volume, number of data streams, and other ingestion KPIs.
Requirements:
Strong experience in data engineering, ETL, and data architecture.
Experience working with data models.
Hands-on experience with Airflow and MuleSoft.
Strong SQL skills with Snowflake and other relational databases.
Experience writing complex Python modules for custom ETL workflows.
Expertise in building batch and real-time data pipelines.
Experience with dbt for data transformation and modeling.
Familiarity with AWS/GCP and distributed/event-driven architectures.
Strong understanding of data modeling, data warehousing, and big data processing.
Experience with data quality, monitoring, and pipeline orchestration frameworks.
Ability to work closely with Product, Data Science, and Analytics teams.
Required Skills:
Ownership
Clear Communication
Sense of Urgency
Proficiency in learning
#AditiConsulting
# 26-03263