JB

AI platform architect · Europe / Remote

I make ambitious AI
work in production.

I design and build private AI platforms, tune LLM inference, and ship the applications that run on top—without handing your roadmap to an external API.

Discuss a project ↗Read the résumé ↗
Billionstokens served / week
Multi-tenantshared AI platform
Multi-nodeH100 & L40S GPU fleet
5M+end users supported

From GPU to user,
one accountable engineer.

01

AI platform architecture

Design or evolve a self-hosted control plane for language, vision, speech, embeddings and image generation—with sensible gateways, observability and capacity planning.

  • Kubernetes & Ray Serve
  • LiteLLM gateways
  • GPU capacity planning
02

Inference performance

Benchmark the workload that matters, find the bottleneck, and choose a serving layout from evidence—not vendor slides.

  • vLLM & FlashInfer
  • Latency / throughput
  • H100 & L40S
03

Production AI systems

Build resilient application layers for media and knowledge workflows, including long-running jobs, RAG, speech and document understanding.

  • Python & PostgreSQL
  • Speech / OCR pipelines
  • Reliable async workflows
04

Technical advisory

Turn a fuzzy AI initiative into an actionable architecture, benchmark plan and delivery path your team can own.

  • Architecture reviews
  • Build-vs-buy
  • Team enablement

02 Selected systems

Built, measured,
operated.

Media AI · RTBFProduction
99%

Faster agentic workloads

Designed prefix-cache-aware routing and a shared client harness. Warm requests that once waited up to 90 seconds now reach first token in under one second.

RoutingKV cacheReliability
Media control plane · RTBFProduction
24 GPUs

Resilient multimodal jobs

Built a PostgreSQL-backed job system with capacity-aware dispatch, leases, retries, cancellation fencing, ordered callbacks and atomic artifacts for speech and OCR.

PostgreSQLWhisperXPaddleOCR

Selected details only. Client-sensitive architecture and outcomes can be discussed privately.

Jean-Baptiste Gidrol at EBU DTS 2025
EBU DTS 2026 · Photo © Nathalie Mastail-Hirosawa

03 About

Hands-on enough to debug it. Senior enough to simplify it.

I’m Jean-Baptiste, an AI platform architect and inference engineer working between deep systems engineering and useful products.

At RTBF, I operate the AI platform behind editorial tools and media workflows while supporting recommendation systems used by millions. I care about performance, reliability and technological sovereignty because production makes vague claims expensive.

I also lead AI compute and inference initiatives at Amaris Consulting. My earlier path through data engineering and video editing gives me an unusual lens: infrastructure matters, but the human workflow at the end matters more.

Core toolkit
Python · Kubernetes · Ray · vLLM · Kafka · PostgreSQL · Neo4j · AWS · Azure · Terraform
Languages
French & English (fluent) · Chinese & Japanese (B1)

04 Field notes

Notes from the
production edge.

Practical lessons from building and running AI systems.
Inference · 8 min

The benchmark said one second. Production said ninety.

What theoretical load tests reveal—and why KV-cache locality decides whether an agent feels instant or broken.

Read field note ↗
Platform · Upcoming

What a private AI gateway actually needs

Keys and routing are the easy part. Ownership, fallbacks and observability decide whether teams trust the platform.

In the notebook
Reliability · Upcoming

Long-running AI jobs without the chaos

Why leases, idempotency and atomic artifacts matter when inference lasts minutes.

In the notebook
Browse all writing →

05 Ways to work together

Bring me in where
the stakes are real.

01

Architecture sprint

Pressure-test the choices and leave with a prioritized delivery plan.

Typically 1–2 weeks
02

Embedded delivery

Build a platform, unblock inference performance, or ship a production workflow.

Fractional or full-time
03

Performance review

Benchmark serving options and turn the results into concrete changes.

Focused engagement

Have a hard AI systems problem?

Let’s make it
work.

Tell me what you’re building, what is stuck, and what success looks like. I’ll reply with a useful next step.

jbgidrol@hotmail.fr ↗
LinkedIn ↗GitHub ↗Résumé ↗