Senior Data Engineer

Join our Data & AI Platform team at Netline and become the lead Data Engineer for our Netline Data & AI platform, powering production-grade AI applications for the airline industry.

As the lead Data Engineer for Netline, you will be responsible for architecting, building, and operating the core data infrastructure and engineering solutions that enable innovative AI-driven capabilities across the aviation ecosystem.

Working closely with the Product Owner and the Netline AI team who are developing AI solutions, you'll be the technical expert ensuring our Databricks-powered platform provides scalable, reliable, and efficient data foundations that enable seamless AI/ML workloads and use cases.

Your Key Responsibilities

• Architect and implement scalable data infrastructure for the Netline Data & AI platform primarily on Azure, leveraging Databricks as the core data platform along with Azure Data Lake Storage, Event Hubs, Data Factory, and other Azure services (with GCP alternatives as secondary: Databricks on GCP, BigQuery, Dataflow, Pub/Sub, Cloud Composer)
• Design and build comprehensive data engineering pipelines (batch & streaming) using Databricks, Spark, Airflow/Azure Data Factory, and Delta Lake
• Implement robust data ingestion, transformation, and serving layers using Databricks that support diverse AI/ML workloads.

Platform Development

• Build and maintain containerized data services using Docker and Kubernetes (AKS/GKE), ensuring optimal performance, security, and scalability
• Develop Databricks-based platform capabilities that enable efficient data processing and model serving for AI applications
• Implement infrastructure-as-code practices using Terraform/ARM templates for consistent Databricks workspace and Azure resource deployments.

Technical Excellence

• Collaborate closely with the Product Owner to translate platform requirements into robust technical solutions
• Work directly with the Netline AI team to understand their AI solution requirements and ensure the Databricks platform supports their use cases effectively
• Integrate data pipelines with ML workflows and model deployment processes using Databricks MLflow and other ML capabilities to enable seamless AI solution development
• Establish and maintain engineering best practices for data quality, lineage, and governance that support AI workloads.

Operations & Reliability

• Implement comprehensive monitoring, alerting, and observability solutions using Application Insights, Prometheus, Grafana, ELK stack
• Ensure high availability, disaster recovery, and security compliance across all Netline platform components
• Optimize platform performance, cost efficiency, and resource utilization.

.

Experience Requirements

• Minimum 5+ years of hands-on data engineering experience
  with proven track record of building and operating production data systems
• Minimum 2+ years of platform engineering experience
  designing and implementing data platforms or similar infrastructure solutions.

Technical Expertise

• Bachelor's, Master's or PhD in Computer Science, Engineering, Mathematics or related quantitative field
• Expert-level programming skills in Python (Scala/Java preferred for big data scenarios)
• Deep expertise with Databricks
  and its ecosystem (Databricks SQL, MLflow, Delta Lake, Unity Catalog)
• Strong experience with Azure data services (Azure Data Lake Storage, Event Hubs, Data Factory, Synapse) with GCP knowledge as a plus
• Advanced Spark experience with large-scale data processing and optimization on Databricks
• Strong containerization and orchestration skills (Docker, Kubernetes/AKS/GKE)
• Proven experience with CI/CD pipelines and infrastructure-as-code (Terraform, ARM templates)
• Solid understanding of cloud networking, security, and governance principles
• Experience with both SQL and NoSQL databases (PostgreSQL, Cosmos DB, etc.)

Professional Qualities:

• Excellent communication and collaboration skills in English
• Strong problem-solving abilities with attention to detail and system reliability
• Self-motivated with ability to work independently and take ownership of technical deliverables
• Experience working closely with product teams to translate requirements into technical solutions

Preferred Skills:

• Experience with modern data architecture patterns (data mesh, lake house, streaming-first architectures) on Databricks
• Hands-on experience with real-time streaming platforms (Kafka, Azure Event Hubs, Pulsar) integrated with Databricks
• Knowledge of MLOps and AI platform requirements using Databricks MLflow and model serving capabilities
• Familiarity with emerging AI/ML technologies (LLMs, vector databases, retrieval-augmented generation) and their implementation on Databricks
• Experience in airline industry or similar data-intensive operational environments
• Background in platform engineering, DevOps, or site reliability engineering

Growth Opportunities

• Be the technical expert driving the Netline Data & AI platform development using cutting-edge Databricks capabilities
• Work with advanced data technologies and AI/ML frameworks in the aviation industry
• Collaborate closely with the Product Owner and Netline AI team to shape platform capabilities that directly enable AI solutions
• Opportunity to architect and build enterprise-scale data solutions on Databricks from the ground up
• Work in a focused team environment with direct impact on AI solution development and platform utilization

Ready to become the technical backbone of our Databricks-powered Netline Data & AI platform? We'd love to hear from you.

What we are proud to provide you with

• Hybrid working with even only weekly 1-2 office days and flexible working hours based on core time.
• Financial benefits such as; an outstanding amount of cafeteria, referral reward and team or individual reward based on your accomplishments.
• Corporate health insurance package at one of the largest private healthcare providers with nationwide coverage.
• Carefully designed career paths, with the appropriate training courses and projects to accomplish your aims such as language courses, tech talks and trainings for your needs.
• Lufthansa Group flight ticket discounts.
• What's more, if you are interested in our additional benefits: check out our benefits page.

Our community is characterized by mutual respect and a spirit of helpfulness. This high level of professionalism, combined with diverse personalities, will help you go through your daily life in a good mood while making the most of your skills and talents.

In addition to an inclusive and helpful atmosphere, trust is also an important value for us. You can rely on us with anything right from your first day, and we also trust you to the utmost extent.

Are you ready to fly with us? Apply now