Jobs Description
Title: Data Engineer- Aviation Data Analytics Location: Remote Duration: 4 years Project work entails further development and maintenance of the Aviation Data Analytics Warehouse platform, including integration of new datasets, implementation of enhancements to pipelines, troubleshooting bugs, and providing detailed documentation. This work requires experience with agile project delivery management and experience in Microsoft Azure cloud development. We are creating a team of Program Manager, Cloud Architect/Team Lead, Data Engineer, and QA/QC Specialist.
Responsibilities
- Data Ingestion and Integration: Develop new and maintain existing data pipelines in ADAW, including configuring automated data extraction processes and troubleshooting ingestion failures and data source connectivity issues.
- Extract Load Transform (ELT): Design and build ELT workflows, including standardizing and cleaning the data according to PA data governance and business rules; create reusable transformation frameworks in Azure Synapse, and optimize pipeline performance and processing.
- Data Warehouse Development: Create and manage database objects (tables, views, stored procedures) to support serverless, dedicated pool, and SQL Server databases.
- Semantic Data Modeling: Design and maintain efficient semantic models in PowerBI to support business intelligence and reporting requirements
Qualifications
- Microsoft Azure Platform, including Synapse Analytics, Data Factory, Azure SQL, Databricks, and DevOps.
- Relational databases, including Microsoft SQL Server.
- Microsoft Power Platform, including Power Apps, Power Automate, and Power BI.