About Ahmed
I help companies design and optimize Databricks-based data platforms on Azure.
Many organizations struggle with high Databricks costs, unstable pipelines, and missing governance. I specialize in building scalable, cost-efficient architectures using Delta Lake, Unity Catalog, and Infrastructure as Code.
With experience in enterprise environments and a Databricks Professional certification, I deliver production-ready data platforms — not just notebooks.
Things I specialize in:
✔ Databricks platform setup from scratch
✔ Migration from legacy data warehouse to Delta Lake
✔ Cluster optimization & cost monitoring
✔ CI/CD for data platforms
✔ Unity Catalog governance setup
Arabic
Native or bilingual
English
Native or bilingual
Dutch
Conversational
Can work on-site
Antwerp (up to 50km)
Experience
- Mediterranean Shipping CompanySenior Data EngineerOctober 2024 - Today (1 year and 8 months)Antwerp, Belgium• Build and maintain scalable data pipelines to ingest and process diverse event-driven data streams, including telemetry and other IoT-generated events.• Utilize Databricks and Delta Lake for efficient storage, transformation, and querying of large-scale datasets.• Develop and manage CI/CD pipelines using Azure DevOps to automate deployment and testing processes.• Implement Infrastructure as Code (IaC) solutions with Bicep for consistent and efficient infrastructure provisioning.• Ensure robust version control and collaboration using Azure DevOps Git repositories.• Collaborate with data scientists and stakeholders to design and implement end-to-end data workflows.• Monitor and optimize data pipelines for performance, reliability, and cost-efficiency.• Enable data governance and security by defining and enforcing standards for data cataloging, versioning, and access control.• Generate actionable insights through exploratory data analysis and custom analytics solutions tailored to varied data types.
- Melexis Technologies NVData EngineerOctober 2023 - September 2024 (10 months)Tessenderlo, LI, Belgium• Designed and implemented data pipelines using Databricks and Airflow.• Orchestrated pipelines using Airflow and Databricks Workflows (jobs).• Leveraged PySpark to transform and load data into efficient formats (Delta Lake) for optimized analytics.• Automated data product deployments using Databricks jobs within a GitLab CI/CD pipeline.• Developed cost monitoring and control mechanisms for Databricks, optimizing resource utilization.• Ensured platform maintainability through Infrastructure as Code (IaC) using Terraform.• Implemented Databricks Unity Catalog to streamline data management and governance.• Communicated technical solutions to data engineering, BI, and end-user teams to ensure alignment.
- Verhaert - Masters In InnovationData scientist/ EngineerDecember 2022 - September 2023 (10 months)Antwerp, Belgium• Microsoft Azure Data demonstrating a strong foundation in Azure data services.• Leveraged expertise in Azure Databricks platform for efficient data ingestion and transformation.• Developed data pipelines to ingest, curate, and consolidate big data from diverse sources (SQL server, CSV, XML, JSON).• Wrote PySpark (and SQL) notebooks to transform and load data into formats like Parquet and Delta Lake.• Trained and tested machine learning and deep learning models for various applications.• Optimized data pipelines for performance and scalability to ensure efficient data processing.• Deployed and maintained machine learning models in production environments for real-world impact.
Recommendations
Be the first to recommend Ahmed
Help this freelancer shine by sharing your experience working together.
These freelancer profiles also match your criteria
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Education
- PhD in Nuclear PhysicsKU Leuven2022
- Master of ScienceUniversity of Applied Sciences (FH Aachen)2018European Master of Science
Certifications
- Databricks Certified Data Engineer ProfessionalDatabricks2025
- Databricks Certified Data Engineer AssociateDatabricks2024