T1 · JUNIOR
Design semantic search for a docs site
Embeddings, a vector index, and a golden set. The retrieval warm-up.
#embeddings#chunking#rag-pipeline
T1 · JUNIOR
Design smart compose (email autocomplete)
Sub-100ms LLM completions at keystroke rate. Latency is the product.
#ttft-tpot#token-economics#prompt-caching
T1 · JUNIOR
Design a FAQ support chatbot
Grounded answers, guardrails, and a human handoff.
#rag-pipeline#moderation-models#pii-redaction
T1 · JUNIOR
Design a spam & toxicity classifier
Classic ML under class imbalance. Choose the right metric first.
#ml-problem-framing#class-imbalance#offline-metrics
T1 · JUNIOR
Design a meeting summarizer
Long transcripts, structured notes, factuality checks. Async by nature.
#token-economics#structured-outputs#hallucination
T2 · MID
Design 'chat with your docs' for an enterprise
The most-asked GenAI question. Retrieval quality, permissions, evals.
#rag-pipeline#hybrid-search#rerankers
T2 · MID
Design video recommendations (TikTok 'For You')
The classic ML flagship. Two-stage pipeline, features, cold start.
#two-stage-recsys#candidate-generation#ranking-models
T2 · MID
Design fraud detection (Stripe)
An adversary in the loop. Fresh features, skew, delayed labels.
#ml-problem-framing#class-imbalance#feature-freshness
T2 · MID
Design ad click prediction
The Meta staple. Features, leakage, calibrated probabilities, A/B.
#ranking-models#feature-engineering#data-leakage
T2 · MID
Design AI-powered product search
Hybrid retrieval, rerank, generated answers. Search that cites.
#hybrid-search#rank-fusion#rerankers
T2 · MID
Design an ETA / delivery-time prediction system
The regression staple. Geospatial features, real-time traffic, freshness.
#ml-problem-framing#feature-engineering#feature-freshness
T2 · MID
Design a document extraction pipeline
PDFs to typed JSON at scale. Schemas, retries, error analysis.
#structured-outputs#constrained-decoding#error-analysis
T3 · SENIORabove your band Design ChatGPT
The flagship. Streaming, memory, moderation, GPU serving, cost.
#kv-cache#continuous-batching#prompt-caching
T3 · SENIORabove your band Design an AI coding assistant (Copilot)
Tab-completion latency + chat depth. Context is the scarce resource.
#prefix-reuse#context-engineering#ttft-tpot
T3 · SENIORabove your band Design an LLM evaluation platform
Judges, golden sets, CI gates. The system that grades the systems.
#llm-as-judge#golden-datasets#regression-gates
T3 · SENIORabove your band Design an inference system for a single GPU fleet
Anthropic's actual question. Batching, KV memory, goodput under SLOs.
#continuous-batching#paged-attention#speculative-decoding
T3 · SENIORabove your band Design visual search (Pinterest Lens)
Image embeddings at billions scale. Index choice, rerank, freshness.
#embedding-selection#ann-search#vector-databases
T3 · SENIORabove your band Design real-time recommendations
Session-aware recs in seconds. Streaming features, freshness SLAs.
#stream-processing#feature-freshness#two-stage-recsys