Lead Data Engineer
At GS1, we are responsible for developing and implementing a universal, global system of standards for identifying objects, capturing data, and sharing information across the supply and demand chains.
We are seeking a highly skilled Lead Data Engineer to join our growing data team. The role will lead the design, implementation, and optimization of scalable data platforms, drive best practices in data engineering, and collaborate with cross-functional teams to deliver data products that power business decisions. This position requires strong technical leadership, hands-on engineering expertise, and experience in building data infrastructure in cloud environments.
Responsibilities - Data Engineering Lead, scalable data platforms
Lead and mentor a team of data engineers, promoting a culture of ownership, quality and continuous improvement.
Architect, build and maintain reliable, high-performance data pipelines for batch and real-time processing.
Design and implement data models, data warehouses and data lakes to support analytics, BI and machine learning use cases.
Define and enforce data engineering standards: data quality, observability, testing and CI/CD for data workloads.
Collaborate with data scientists, analysts, product managers and software engineers to translate business requirements into technical solutions.
Drive cloud data infrastructure strategy and optimization, including cost management and performance tuning.
Establish data governance practices, metadata management and data lineage to ensure compliance and trust in data assets.
Evaluate and introduce new tools, frameworks and best practices to improve team productivity and system reliability.
Required skills - technical expertise in data engineering
Proven experience leading and delivering data engineering projects in a technical lead or senior engineer role.
Expert knowledge of ETL/ELT patterns, data integration, streaming (e.g. Kafka, Kinesis) and batch processing frameworks (e.g. Spark).
Strong SQL skills and experience designing dimensional and normalized data models for analytics and reporting.
Cloud data platform experience (AWS, GCP or preferably Azure) including managed services for storage, compute and orchestration.
Familiarity with data warehousing technologies (e.g. Snowflake, Redshift, BigQuery) and data lake architectures.
Experience with infrastructure-as-code, containerization (Docker), orchestration (Kubernetes) and CI/CD pipelines.
Programming proficiency in Python, Java or Scala and experience with data engineering libraries and frameworks.
Knowledge of data governance, security best practices, GDPR requirements and data privacy principles.
Desirable skills - additional experience and tools
Experience with observability and monitoring tools for data systems (e.g. Prometheus, Grafana, OpenTelemetry).
Background in machine learning pipelines, feature stores and model deployment systems.
Experience with orchestration tools such as Airflow, Prefect or Dagster.
Familiarity with metadata solutions like Amundsen, DataHub or Glue Data Catalog.
Experience in cost optimization and performance tuning for large-scale data platforms.
Qualifications - education and professional background
Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science or related field, or equivalent practical experience.
7+ years of professional data engineering experience, including 2+ years in a senior/technical lead role delivering production-grade data platforms.
Track record of delivering production-grade data systems that meet operational SLAs.
Strong communication skills with experience presenting technical concepts to non-technical stakeholders.
- Department
- Data
- Role
- Data Engineering Lead
- Locations
- Heliopolis, Cairo Governorate, Egypt
- Remote status
- Hybrid
- Employment type
- Full-time
About GS1 Egypt
Established in 1997, GS1 Egypt is a member of the GS1 Global community, the world’s #1 source of barcodes and global standards. Since its founding, GS1 Egypt has expanded its role as the leading barcode provider to supporting companies and organizations in Egypt across a wide range of fields.
As of 2009, GS1 Egypt expanded its network of government partners to provide more services, including governance and compliance, for businesses across the entire supply chain.