Hafiz S.M. Faizan Ali · AI / Backend Engineer
// computer vision · biometrics · agentic ai · llm systems

I build the AI behind the product.

AI / Backend Engineer building production systems across computer vision, biometrics, real-time detection, agentic assistants and document intelligence — from custom YOLO and FaceNet models to self-hosted LLM inference on multi-GPU hardware.

inference_pipeline.py running
Sense
Preprocess
Analyze
Reason
Respond

What I work with

[ 4 domains ]

Computer Vision

Custom YOLO detection & training, Mediapipe landmarks, FaceNet embeddings, pose estimation, Roboflow, OpenCV.

OCR

PaddleOCR, Google Vision, DocTR, Tesseract — benchmarked and selected per document quality.

LLM & Agents

Self-hosted Gemma via llama.cpp, LangGraph routing, prompt-engineered extraction, OpenAI, Redis memory.

Backend & Infra

FastAPI async services, Docker, multi-GPU serving (5× RTX 3090), TFLite, PostgreSQL / MongoDB.

Featured work

[ production ]

Selected projects

[ 8 systems ]
biometric · anti-spoofliveness

Liveness Detection System

Real-time detection of live faces vs. photo, video or mask spoofs for mobile authentication.

Mediapipe facial landmarks + temporal ROI movement analysis across frame windows, served over FastAPI with a sliding-window classifier.

→ ~85% fewer false positives vs. naive frame-based detection.
FastAPIMediapipeOpenCVDocker
biometric · identityfingerprint

Remote Biometric Verification

Remote fingerprint verification from a mobile app, meeting NADRA image-quality standards — no branch visit needed.

Multi-stage custom YOLO pipeline (hand → left/right → finger region) with preprocessing to the required pore format; TFLite for low-latency inference.

→ Removed in-person verification; scalable across multiple banks.
FastAPIYOLOTFLiteRoboflowDocker
document intelligenceocr

ID Card Data Extraction

Automated identity-data capture from mobile ID-card photos to speed up bank customer onboarding.

YOLO card detection + perspective correction, then an OCR engine benchmark (Tesseract / DocTR / Google Vision) with structured parsing of the winner.

→ Eliminated manual transcription; faster, more accurate onboarding.
FastAPIYOLOGoogle VisionOpenCV
computer vision · realtimesurveillance

Smart Surveillance System

Real-time event detection & alerting for CCTV / doorbell feeds — fire, weapons, parcels, pets and falls.

Multiple custom YOLO detectors + pose estimation, async FastAPI + WebSocket streaming, and priority-based alert logic (weapon > fire > parcel).

→ Instant critical-event alerts with no manual monitoring.
FastAPIYOLOPyTorchWebSocketDocker
biometric · identityface-id

Face Recognition Auth

Face-based login for mobile apps using biometric embeddings instead of passwords or PINs.

Mediapipe alignment → FaceNet embeddings, similarity-threshold matching with multi-image enrollment for more robust representation.

→ Secure, fast auth; tuned thresholds to balance false accept / reject.
FlaskFaceNetMediapipePostgreSQL
agentic · llmvoice

Voice AI Assistant for IoT

Voice-first assistant that answers questions and controls smart devices through one conversational interface.

LangGraph intent routing (knowledge / live search / device command), device-registration DB validation before acting, and Redis short-term memory.

→ Natural-language IoT control; reusable agent architecture.
FastAPILangGraphSerperRedisOpenAI
document intelligencebatch

Medical Packet Analysis

Batch classification & extraction across large medical / legal PDF packets into structured Excel summaries.

Hybrid classification — regex-first with an LLM fallback for ambiguous docs — plus per-type parsers for doctor, dates and metadata, with validation.

→ Turned hours of manual review into an automated batch job.
PythonFastAPIGoogle VisionOpenPyXLPandas
document intelligenceend-to-end

Medical Billing Autopilot

Classifies billing documents, extracts patient fields, and creates dashboard records via API — fully automated.

Regex-first + local Gemma fallback classification, multi-engine OCR chosen by quality, prompt-engineered extraction and a validation layer before any record is written.

→ Automated data entry at scale; removed external LLM dependency.
Local GemmaPaddleOCRFastAPIOpenCVDocker
Get in touch

Let's build something.

Open to AI / Backend engineering roles focused on document intelligence, computer vision and LLM systems.

Detailed project reports & architecture available on request — repositories are private.