Software Architecture
System Design & Patterns, Microservices & Event-Driven, API Design (REST, Async), High Availability & Resilience.
Software & Data Architect with 10+ years of experience designing robust, scalable, and high-performance systems across data platforms, software engineering, and applied AI. Deep expertise in Apache Spark, distributed Big Data architectures, and end-to-end software system design — from data lake to production ML microservices. Proven track record of architecting production-grade pipelines, defining architecture standards, and leading engineering teams. Simultaneously active as an Innovation Leader (FABLAB Manager), driving rapid prototyping and AI-assisted development for digital transformation initiatives. Co-founder of multiple tech startups, with hands-on experience building AI-powered products from zero to deployment.
System Design & Patterns, Microservices & Event-Driven, API Design (REST, Async), High Availability & Resilience.
Data Platform & Lakehouse Design, Data Governance & Quality, ETL / ELT Pipelines, Apache Spark (PySpark, 3-4 yrs).
LLM Integration & Agent Systems, ML Microservice Architecture, AI-Powered Product Design, FABLAB & Innovation Leadership.
Software & Data Architect - FABLAB Innovation Manager, Leyton (Nov 2021 – Present, Casablanca, Morocco)
Head of Engineering (Part-time), Inowaiv IA (Nov 2024 – Present, Casablanca, Morocco)
Co-Founder & Software and Data Architect (Part-time), Archipel Cognitive (May 2021 – Present, Casablanca, Morocco)
Big Data Systems Architecture Consultant, Independent (Aug 2020 – Oct 2021, Casablanca, Morocco)
Co-Founder & Head of Technologies, DECOD (Jan 2020 – Jan 2022, Casablanca, Morocco)
Head of Data Science, The Good Data Factory (Dec 2019 – Jul 2020, Rabat, Morocco)
Product Lead - Data & Machine Learning Engineer, The Good Data Factory (Dec 2017 – Dec 2019, Rabat, Morocco)
| Project | Architecture Focus | Stack |
|---|---|---|
| Spark Job Industrial Pipeline | End-to-end batch processing: job submission, orchestration, real-time supervision | Spark, Livy, Airflow, Jenkins, Hadoop, Elasticsearch, Kibana |
| Async Task Execution Reference Arch. | Distributed async processing pattern for high-throughput workloads | FastAPI, Celery, Redis, Airflow, Flower |
| Data Sync Middleware Architecture | Event-driven CDC-based sync between enterprise systems (Salesforce ↔ Odoo) | Kafka, Debezium, Redis, PushTopics |
| Multi-Agent AI Framework | Orchestrated multi-agent system for custom business process automation | AgentScope, Kafka, AKS, Azure Cosmos DB, Grafana |
| Azure OpenAI Load Balancer | Scalable API gateway architecture for LLM services with identity management | Azure API Management, Azure AD, Managed Identity |
| Automated Social ETL Pipeline | Frequency-based data ingestion and transformation pipeline | Azure ADF, Azure Functions, Managed Elasticsearch |
| Achgal Insights (Social Analytics) | Full data pipeline + AI-powered insight product for social listening | Azure, Elasticsearch, Python, FastAPI |
| Scalable AI Data Pipeline | Real-time AI insights pipeline for decision intelligence | Azure Databricks, Spark, Azure API Management, Redis, Kibana |
| Software Architecture | System Design, Microservices, Event-Driven Architecture, Design Patterns, API Design (REST, Async), High Availability & Resilience |
| Data Architecture | Data Platform Design, Lakehouse / Data Lake, Data Governance & Quality, ETL / ELT Pipelines |
| Apache Spark & Big Data | PySpark (3-4 years), Spark Batch & Streaming, Apache Livy, Databricks (Delta Lake), Azure HDInsight, Hadoop (Ambari), Hive |
| Data Engineering | Apache Kafka, Airflow, dbt, Debezium (CDC), ELK Stack (Elasticsearch / Kibana), Jenkins, Docker, Git, Redis |
| Applied AI & LLMs | Azure OpenAI, LangChain, RAG, Multi-Agent Systems (AgentScope), Generative AI tooling, ML Microservices |
| Cloud | Azure (AKS, ADF, Functions, Blob Storage, API Management, OpenAI, Cosmos DB, Managed Identity) · AWS (S3, EC2, ECS, Lambda, CloudFront) |
| Databases | SQL · NoSQL: MongoDB, Cassandra, Azure Cosmos DB, Elasticsearch, PostgreSQL |
| Languages & Frameworks | Python, PySpark, SQL, NodeJS · FastAPI, Celery, Flower |
| Methodologies | Agile / Scrum · Kanban · DevSecOps (exposure) · FABLAB / Rapid Prototyping |
| Low Code / No Code | Mendix, OutSystems, Bubble, AppSmith, FlatLogic |
Master’s in Engineering and Systems Optimization (2014 - 2016)
Faculty of Science Ain Chock, University of Hassan II, Casablanca, Morocco.
Bachelor of Mathematics and Computer Science (2011 - 2014)
Faculty of Science Ain Chock, University of Hassan II, Casablanca, Morocco.
Reach out to discuss opportunities or collaborations. Contact me at elmehdibenyoussef@gmail.com or call me at (+212) 657507236.