Open to AI Engineering opportunities

Hi, I'm Babar Ali

AI Engineer

Specializing in
Innsbruck, Austria
About

Engineering intelligent systems

M.Sc. Software Engineering student at the University of Innsbruck, Austria, passionate about building AI-powered applications and robust backend infrastructure.

AI Applications

Building production-grade RAG pipelines, LLM integrations, and intelligent retrieval systems that ground model outputs in real data.

Backend Systems

Designing scalable APIs, microservices, and data pipelines with a focus on reliability, performance, and clean architecture.

Cloud Deployments

Deploying and orchestrating applications on modern cloud infrastructure with CI/CD, containers, and infrastructure-as-code.

University of Innsbruck

Pursuing an M.Sc. in Software Engineering at the University of Innsbruck, Austria, combining academic research with hands-on engineering in AI and distributed systems.

Featured

Spotlight project

A deep dive into my most impactful work in multimodal AI retrieval.

Featured Project
aibackendComing to GitHub

Rankify

Multimodal Retrieval Evaluation

Benchmarking retrieval quality across text, image, and multimodal embeddings

Tech Stack

PythonPyTorchFAISSCLIPFastAPIDockerPostgreSQLWeights & Biases

The Problem

Evaluating retrieval systems across modalities is fragmented. Teams lack a unified framework to compare embedding models, ranking strategies, and fusion techniques on real-world multimodal datasets.

The Solution

Rankify provides a standardized evaluation pipeline for multimodal retrieval, enabling systematic comparison of retrieval architectures with reproducible metrics and visual analytics.

Key Results

  • Unified evaluation across 5+ embedding models with consistent recall@k metrics
  • 40% faster benchmarking pipeline through parallel index builds
  • Reproducible experiment tracking with automated report generation
  • Open architecture supporting custom datasets and fusion strategies
Projects

Engineering in production

End-to-end systems spanning AI agents, RAG pipelines, inference infrastructure, and cloud deployments.

aibackendComing to GitHub

AgentForge

Multi-Agent Orchestration Platform

Coordinating specialized AI agents with tool use, memory, and MCP protocol integration

Tech Stack

PythonLangGraphOpenAIMCPRedisFastAPIDockerLangSmith

The Problem

Single-prompt LLM workflows break down on complex tasks. Developers need reliable multi-step reasoning with tool calling, state management, and observability across agent handoffs.

The Solution

AgentForge orchestrates specialized agents (planner, researcher, executor) with shared memory, MCP tool connectors, and structured output validation for reliable autonomous workflows.

Key Results

  • 3-agent pipeline reduced task completion errors by 62% on multi-step benchmarks
  • MCP tool integration supports 12+ external connectors out of the box
  • Built-in tracing and replay for debugging agent decision paths
  • Sub-200ms agent handoff latency with Redis-backed state store
aibackend

ContextWeave

Production RAG Pipeline

Enterprise-grade retrieval with hybrid search, reranking, and citation-grounded generation

Tech Stack

PythonLangChainQdrantOpenAICohereFastAPICeleryPostgreSQL

The Problem

Naive vector search produces irrelevant context and hallucinated answers. Production RAG systems need hybrid retrieval, cross-encoder reranking, and strict source attribution.

The Solution

ContextWeave implements a full RAG stack: document chunking with semantic boundaries, BM25 + dense hybrid search, Cohere reranking, and citation-enforced LLM responses with confidence scoring.

Key Results

  • 34% improvement in answer relevance vs. naive vector-only retrieval
  • Hybrid search + reranking pipeline processes 10k documents in under 4 minutes
  • Every generated answer includes verifiable source citations
  • Chunk-level metadata tracking for audit and compliance workflows
aicloudbackendComing to GitHub

InferGrid

LLM Inference Gateway

High-throughput API gateway with semantic caching, routing, and cost-aware model selection

Tech Stack

GoRedisPostgreSQLOpenAIAnthropicDockerKubernetesPrometheus

The Problem

Teams running LLMs in production face unpredictable latency, redundant identical queries, and spiraling API costs without a unified gateway for routing, caching, and rate control.

The Solution

InferGrid sits between applications and model providers, offering semantic response caching, intelligent model routing (fast vs. capable), per-tenant rate limits, and real-time cost analytics.

Key Results

  • Semantic cache hit rate of 38% reducing average API costs by 41%
  • P99 latency under 120ms for cached responses at 500 req/s
  • Automatic failover between model providers with zero-downtime routing
  • Per-tenant usage dashboards with token-level cost breakdowns
aibackendComing to GitHub

GraphMind

GraphRAG Knowledge Engine

Transforming unstructured documents into queryable knowledge graphs for enterprise intelligence

Tech Stack

PythonNeo4jLangChainOpenAINetworkXFastAPIDockerQdrant

The Problem

Traditional RAG misses relational context. When users ask how entities connect across thousands of documents, flat vector search fails to surface structural relationships and multi-hop reasoning paths.

The Solution

GraphMind extracts entities and relationships using LLMs, builds a Neo4j knowledge graph, and combines graph traversal with vector search for GraphRAG and complex relational queries over document corpora.

Key Results

  • Multi-hop query accuracy improved 47% over flat RAG on enterprise benchmarks
  • Automated entity extraction pipeline processes 1,000 pages/hour
  • Hybrid graph + vector retrieval with explainable reasoning paths
  • Community detection surfaces implicit topic clusters across document sets
cloudbackendComing to GitHub

DeployKit

AI Workload Cloud Orchestrator

One-command deployment of GPU inference services with auto-scaling and observability

Tech Stack

PythonKubernetesDockerTerraformHelmGrafanaAWS EKSGitHub Actions

The Problem

Deploying ML models to production requires stitching together containers, GPU scheduling, health checks, and monitoring. It is a fragmented process that slows iteration for AI engineering teams.

The Solution

DeployKit provides a CLI and GitOps workflow to deploy containerized AI services to Kubernetes with GPU node affinity, HPA auto-scaling, OpenTelemetry tracing, and Grafana dashboards pre-configured.

Key Results

  • Deploy inference services from Docker image to production in under 8 minutes
  • GPU-aware scheduling with 95% utilization on batch inference workloads
  • Pre-built Grafana dashboards for latency, throughput, and GPU metrics
  • GitOps pipeline with automatic rollback on health check failures

Repositories launching on GitHub soon

Skills

Tools & technologies

A curated stack spanning AI/ML, backend engineering, cloud infrastructure, and modern frontend.

AI & ML

Python
PyTorch
LangChain
RAG
LLMs
FAISS

Backend

Node.js
FastAPI
PostgreSQL
Redis
GraphQL
REST APIs

Cloud & DevOps

Docker
Kubernetes
AWS
Vercel
GitHub Actions
Terraform

Frontend

TypeScript
React
Next.js
Tailwind CSS
Framer Motion
Experience

Where I've been

Academic journey and professional experience building real-world systems.

2023 to Present

M.Sc. Software Engineering

University of Innsbruck · Innsbruck, Austria

  • Research focus on retrieval-augmented generation and multimodal AI systems
  • Advanced coursework in distributed systems, cloud computing, and machine learning
  • Building production-grade AI applications as part of graduate research
Jun 2024 to Present

Software Engineer (Freelance)

Fiverr · Remote

  • Freelance AI and backend engineering for international clients
  • Delivered RAG pipelines, API integrations, and cloud-deployed solutions
  • End-to-end project ownership from architecture to deployment
Jan 2022 to Jun 2024

Software Engineer (Part-time)

Accel Auto · Remote

  • Built and maintained backend services for an automotive platform
  • Developed REST APIs and database layers for core product features
  • Collaborated on system design and performance optimization
Jun 2021 to Aug 2022

Software QA Engineer

LEPUS ANALYTICS · Peshawar, Pakistan

  • Designed and executed test plans for analytics software products
  • Automated regression testing and improved release quality workflows
  • Collaborated with engineering teams on bug triage and root-cause analysis
2017 to 2022

B.Sc. Computer Science

University of Engineering and Technology · Pakistan

  • Foundation in algorithms, data structures, and software engineering
  • Led student projects in web development and machine learning
  • Graduated with focus on AI and backend systems
Jan 2021 to Jun 2021

Intern

National Center for Big Data and Cloud Computing (NCBC) · Peshawar, Pakistan

  • Worked on big data and cloud computing research initiatives
  • Gained hands-on experience with distributed systems and data pipelines
  • Contributed to NCBC projects in a collaborative research environment
Schedule

Book a meeting

Pick a time that works for you. 30-minute intro calls for collaborations, interviews, or project discussions.

Loading calendar...

Prefer to open in a new tab? View full calendar

Contact

Let's build something

Have a project in mind or want to discuss opportunities? I'd love to hear from you.