El Mehdi Benyoussef

Software & Data Architect | FABLAB Innovation Manager

Software & Data Architect with 10+ years of experience designing robust, scalable, and high-performance systems across data platforms, software engineering, and applied AI. Deep expertise in Apache Spark, distributed Big Data architectures, and end-to-end software system design — from data lake to production ML microservices. Proven track record of architecting production-grade pipelines, defining architecture standards, and leading engineering teams. Simultaneously active as an Innovation Leader (FABLAB Manager), driving rapid prototyping and AI-assisted development for digital transformation initiatives. Co-founder of multiple tech startups, with hands-on experience building AI-powered products from zero to deployment.


Core Expertise

Software Architecture

System Design & Patterns, Microservices & Event-Driven, API Design (REST, Async), High Availability & Resilience.

Data Architecture & Big Data

Data Platform & Lakehouse Design, Data Governance & Quality, ETL / ELT Pipelines, Apache Spark (PySpark, 3-4 yrs).

Applied AI & Innovation

LLM Integration & Agent Systems, ML Microservice Architecture, AI-Powered Product Design, FABLAB & Innovation Leadership.


Professional Experience

Software & Data Architect - FABLAB Innovation Manager, Leyton (Nov 2021 – Present, Casablanca, Morocco)

  • Own end-to-end software and data architecture across all company systems, ensuring scalability, high availability, maintainability, and security.
  • Architected and industrialized Spark batch job pipelines: end-to-end job submission, monitoring, and supervision via Apache Livy, Jenkins, and Airflow on a Hadoop cluster.
  • Designed a middleware architecture for real-time data synchronization between Salesforce and Odoo using Kafka, Debezium (CDC), and Redis.
  • Designed a reference architecture for asynchronous task execution: FastAPI + Celery + Redis + Airflow + Flower monitoring — now a reusable standard across teams.
  • Defined and enforced architecture standards, design patterns, and software engineering best practices across engineering teams.
  • Lead the FABLAB as an Innovation Manager: driving rapid prototyping, AI-assisted development, and digital innovation projects for the business.
  • Mentor and coach senior engineers on solution architecture, system design, and complex problem-solving methodologies.

Head of Engineering (Part-time), Inowaiv IA (Nov 2024 – Present, Casablanca, Morocco)

  • Designing scalable data architectures for AI-driven solutions, enabling real-time decision-making and intelligent automation.
  • Leading development of AI systems and multi-agent frameworks, streamlining complex business processes and enhancing accuracy.
  • Architected an AI-driven automation system for large-scale participant management using Azure OpenAI, LangChain, Azure Functions, MongoDB, and Prometheus.
  • Developed a generative AI correction tool for automated assessments using Azure Cognitive Services, FastAPI, Elasticsearch, and Airflow.
  • Implemented a multi-agent AI framework for custom business solutions using AgentScope, Kafka, AKS, Azure Cosmos DB, and Grafana.
  • Created a scalable AI data pipeline for real-time insights using Azure Databricks, Spark, Azure API Management, Redis, and Kibana.
  • Deployed a conversational AI agent for client interaction optimization using RAGApp, Azure OpenAI, Managed Identity, and PostgreSQL.
  • Aligned technical roadmaps with business goals, directing cross-functional teams from prototyping through production deployment.

Co-Founder & Software and Data Architect (Part-time), Archipel Cognitive (May 2021 – Present, Casablanca, Morocco)

  • Designed internal and client-facing software and data architectures for AI-powered B2B and B2C products from scratch.
  • Implemented a Load Balancer architecture for Azure OpenAI Services using Azure API Management, Azure Active Directory, and Managed Identity.
  • Architected an automated, frequency-based ETL data pipeline for social data ingestion using Azure ADF, Azure Serverless Functions, and Managed Elasticsearch.
  • Built Achgal Insights: a social listening and analytics product, covering full data pipeline architecture through to AI-powered insight generation.
  • Guided client engineering teams in adopting robust software architecture practices and scalable data platform designs.

Big Data Systems Architecture Consultant, Independent (Aug 2020 – Oct 2021, Casablanca, Morocco)

  • Designed end-to-end data solution architecture for a large-scale Ambari-managed Hadoop cluster.
  • Built an industrialized pipeline for Spark Job submission and real-time supervision via Livy, Jenkins, and Airflow — establishing a reusable pattern for all future Spark workloads.
  • Diagnosed and resolved critical resource allocation bottlenecks on a production Big Data cluster, restoring full operational stability.

Co-Founder & Head of Technologies, DECOD (Jan 2020 – Jan 2022, Casablanca, Morocco)

  • Designed and led development of AI and data platform architectures for enterprise digital transformation projects.

Head of Data Science, The Good Data Factory (Dec 2019 – Jul 2020, Rabat, Morocco)

  • Led the Data Science department, delivering AI solutions for US and Moroccan markets.
  • Architected and deployed ML solutions as microservice APIs on Azure Cloud, leveraging AKS, Azure Functions, and Azure Blob Storage.
  • Defined data & AI technical strategy as a member of the Executive Board.

Product Lead - Data & Machine Learning Engineer, The Good Data Factory (Dec 2017 – Dec 2019, Rabat, Morocco)

  • Led a cross-functional team of Data Scientists and Data Engineers building an AI-powered Marketing platform.
  • Designed the software architecture combining Data Engineering and Data Science pipelines for scalable ML delivery.
  • Applied software engineering best practices (versioning, CI/CD, testing) to deliver robust Python-based ML solutions on Azure Cloud.

Key Architecture Projects

Project Architecture Focus Stack
Spark Job Industrial Pipeline End-to-end batch processing: job submission, orchestration, real-time supervision Spark, Livy, Airflow, Jenkins, Hadoop, Elasticsearch, Kibana
Async Task Execution Reference Arch. Distributed async processing pattern for high-throughput workloads FastAPI, Celery, Redis, Airflow, Flower
Data Sync Middleware Architecture Event-driven CDC-based sync between enterprise systems (Salesforce ↔ Odoo) Kafka, Debezium, Redis, PushTopics
Multi-Agent AI Framework Orchestrated multi-agent system for custom business process automation AgentScope, Kafka, AKS, Azure Cosmos DB, Grafana
Azure OpenAI Load Balancer Scalable API gateway architecture for LLM services with identity management Azure API Management, Azure AD, Managed Identity
Automated Social ETL Pipeline Frequency-based data ingestion and transformation pipeline Azure ADF, Azure Functions, Managed Elasticsearch
Achgal Insights (Social Analytics) Full data pipeline + AI-powered insight product for social listening Azure, Elasticsearch, Python, FastAPI
Scalable AI Data Pipeline Real-time AI insights pipeline for decision intelligence Azure Databricks, Spark, Azure API Management, Redis, Kibana

Technical Skills

Software Architecture System Design, Microservices, Event-Driven Architecture, Design Patterns, API Design (REST, Async), High Availability & Resilience
Data Architecture Data Platform Design, Lakehouse / Data Lake, Data Governance & Quality, ETL / ELT Pipelines
Apache Spark & Big Data PySpark (3-4 years), Spark Batch & Streaming, Apache Livy, Databricks (Delta Lake), Azure HDInsight, Hadoop (Ambari), Hive
Data Engineering Apache Kafka, Airflow, dbt, Debezium (CDC), ELK Stack (Elasticsearch / Kibana), Jenkins, Docker, Git, Redis
Applied AI & LLMs Azure OpenAI, LangChain, RAG, Multi-Agent Systems (AgentScope), Generative AI tooling, ML Microservices
Cloud Azure (AKS, ADF, Functions, Blob Storage, API Management, OpenAI, Cosmos DB, Managed Identity) · AWS (S3, EC2, ECS, Lambda, CloudFront)
Databases SQL · NoSQL: MongoDB, Cassandra, Azure Cosmos DB, Elasticsearch, PostgreSQL
Languages & Frameworks Python, PySpark, SQL, NodeJS · FastAPI, Celery, Flower
Methodologies Agile / Scrum · Kanban · DevSecOps (exposure) · FABLAB / Rapid Prototyping
Low Code / No Code Mendix, OutSystems, Bubble, AppSmith, FlatLogic

Certifications & Awards

  • Azure AZ-900 — Microsoft (2023)
  • Big Data Developer Mastery Award for Students — IBM (2016)

Education

Master’s in Engineering and Systems Optimization (2014 - 2016)
Faculty of Science Ain Chock, University of Hassan II, Casablanca, Morocco.

Bachelor of Mathematics and Computer Science (2011 - 2014)
Faculty of Science Ain Chock, University of Hassan II, Casablanca, Morocco.


Get in Touch

Reach out to discuss opportunities or collaborations. Contact me at elmehdibenyoussef@gmail.com or call me at (+212) 657507236.