Primary Purpose
We are seeking a Data Integration Engineer to design and build secure, scalable data pipelines for our next-generation Air Traffic Management (ATM) platform. In this role, you’ll leverage modern cloud and data technologies (e.g., AWS, Databricks) to enable real-time, data-driven decision-making for safer and more efficient airspace operations. Bonus points for familiarity with AI/Agentic AI or aviation data standards!
Key Responsibilities
✔ Design & Development : Build robust batch and streaming pipelines using AWS, Databricks, and distributed processing tools (Spark, Delta Lake).
✔ Data Optimization : Ensure high-performance processing, transformation, and storage with a focus on security, governance, and cost-efficiency.
✔ Cross-Functional Collaboration : Partner with data scientists, engineers, and aviation experts to support AI-ready architectures and advanced analytics.
✔ Resilience & Observability : Implement monitoring, automation, and fault-tolerant designs for mission-critical systems.
✔ Documentation & Innovation : Maintain clear technical docs and contribute to continuous improvement of data architecture.
Core Qualifications
✅ Technical Expertise :
- Strong hands-on experience with AWS data services (e.g., Glue, Kinesis, Redshift, S3).
- Proficiency in Python/Scala and distributed frameworks like Spark .
- Solid SQL, data modeling, and ETL/ELT skills.
- Experience building scalable pipelines (batch/real-time).
✅ Operational Excellence :
- Knowledge of data security, governance, and compliance (e.g., GDPR, aviation regulations).
- Ability to troubleshoot and optimize for performance vs. cost trade-offs .
Preferred Qualifications
Nice-to-Have :
- Experience with Databricks, Delta Lake, and medallion architecture .
- Exposure to AI/GenAI (e.g., LLMs, agent-based systems) or aviation data (ADS-B, ARINC 424).
- AWS Certifications (Data Analytics, Big Data, or ML Specialty).
- Background in high-volume, real-time systems (e.g., IoT, telemetry).