#AI in Production

Articles about AI in Production — exploring patterns, best practices, and real-world implementations in production systems.

12 posts tagged with ai in production. ← All posts

#A2A (14)#ADK (8)#AG-UI (6)#AI (9)#AI Agents (303)#AI Architecture (10)#AI Cost (10)#AI Cost Optimization (8)#AI Engineering (160)#AI Governance (28)#AI Red Teaming (9)#AI Research (9)#AI Safety (6)#AI Security (21)#AI in Production (12)#AML (3)#API Design (10)#API Security (8)#APIs (47)#AWS (17)#Accounting (9)#Agent Skills (3)#Agentic AI (24)#Agentic Commerce (12)#Agentic RAG (8)#Agents (4)#Amazon Bedrock (8)#Architecture (36)#Audit (3)#Authentication (10)#Authorization (3)#Automation (6)#Azure (11)#Azure AI Foundry (9)#Backend Engineering (267)#BigQuery (6)#CI/CD (8)#Capital Markets (14)#Card Payments (12)#Cards (13)#Career (7)#Checkpointing (4)#Claude Code (8)#Cloud (3)#Cloud Architecture (3)#Code Review (8)#Collaboration (4)#Communication (4)#Compliance (51)#Computer Networking (8)#Concurrency (25)#Consulting (3)#Context Engineering (10)#Cost Optimisation (5)#Credit (14)#Credit Risk (14)#CrewAI (8)#Crypto (12)#Cryptocurrency (12)#Custody (9)#DSPy (8)#Data (4)#Data Engineering (4)#Data Structures (8)#Databases (33)#Deployment (3)#DevOps (9)#DevSecOps (11)#Developer Experience (5)#Distributed Systems (88)#Documentation (3)#Edge AI (8)#Embeddings (14)#Engineering (7)#Engineering Culture (3)#Engineering Practices (16)#Evaluation (44)#Event-Driven Architecture (8)#FREE-AI (8)#FX (5)#FinOps (23)#FinTech (6)#Financial AI (14)#Financial Systems (129)#Fine-Tuning (11)#Fintech (131)#Flutter (8)#Foreign Exchange (5)#Forward Deployed Engineer (8)#Forward Deployed Engineering (8)#Fraud (10)#Function Tools (5)#GCP (5)#Gemma (4)#Go (220)#Google ADK (36)#Governance (55)#Granite (6)#GraphQL (3)#Guardrails (24)#HIPAA (3)#HTTP (3)#Harness Engineering (8)#Hugging Face (8)#Human-in-the-Loop (8)#IBM watsonx (8)#Identity (11)#Integration (3)#Interfaces (3)#KYC (11)#KYC and AML (12)#Kafka (10)#Kubernetes (9)#LLM (5)#LLM Inference (8)#LLMs (110)#LangChain (8)#LangGraph (11)#Ledger (12)#Lending (14)#LlamaIndex (8)#MCP (22)#MLOps (30)#Machine Learning (13)#Markets (4)#Memory (13)#Memory Management (4)#Microservices (3)#Microsoft Agent Framework (150)#Middleware (6)#Migration (9)#Monitoring (3)#Multi-Agent (10)#Multi-Agent AI (14)#Multi-Agent Systems (70)#Multimodal (3)#NIM (5)#NVIDIA (8)#OAuth (3)#OWASP (7)#Observability (43)#On-Device AI (8)#Open Source (6)#OpenTelemetry (5)#Opinion (6)#Orchestration (10)#Payment Rails (16)#Payments (54)#Performance (29)#Platform Engineering (9)#Privacy (4)#Privacy Engineering (3)#Product (4)#Production (6)#Programming (10)#Programming Languages (16)#Prompt Engineering (64)#Prompt Injection (6)#Protocols (9)#Providers (4)#Pydantic AI (8)#Python (142)#Quality (3)#RAG (58)#RBI (3)#REST (5)#Rails (16)#Reconciliation (3)#RegTech (8)#Regulation (9)#Reliability (45)#Resilience (3)#Responsible AI (5)#Retrieval (3)#Risk (13)#Rust (16)#SRE (20)#Scalability (3)#Security (80)#Self-Evolving Agents (16)#Sessions (3)#Settlement (9)#Software Architecture (35)#Software Engineering (138)#Spanner (4)#Strands (8)#Streaming (25)#Structured Output (4)#System Design (32)#Systems Programming (16)#Testing (34)#Tool Use (21)#Tools (3)#Trading (8)#Treasury (6)#Type System (3)#Type Systems (3)#Vector Databases (21)#Vector Search (11)#Web Development (6)#Workflows (14)#gRPC (5)#smolagents (8)
Pratik Dhanave · ·5 min read

Cost, FinOps, and Scaling the Capability

A system can be reliable, safe, and responsible and still fail — by being uneconomical — and the final move is turning one production system into a repeatable capability many teams can build safely.

A system can be reliable, safe, and responsible and still fail by being uneconomical. Phases 10-11: known unit economics and spend guardrails, then a paved road that lets many teams ship governed AI safely.

#AI in Production#FinOps#AI Engineering#Platform Engineering#MLOps#AI Governance#Guardrails
Pratik Dhanave · ·5 min read

Responsible AI and Human Factors

Responsible-AI principles written in a policy do nothing; the work of this phase is turning fairness, transparency, explainability, and human oversight into features the running system actually has.

Responsible-AI principles in a policy do nothing; this phase turns fairness, transparency, explainability, and human oversight into features the running system actually has. Phase 9.

#AI in Production#Responsible AI#AI Governance#AI Engineering#MLOps
Pratik Dhanave · ·5 min read

Observability, Reliability, and Incident Response

You cannot operate what you cannot see, and AI systems fail in ways ordinary monitoring misses — quality silently degrades, cost silently climbs, and inputs silently drift — so observability has to watch the things that don't throw exceptions.

AI fails in ways ordinary monitoring misses — quality degrades, cost climbs, inputs drift, all silently. Phase 8: observability that watches the signals that don't throw exceptions, plus runbooks and a kill-switch.

#AI in Production#Observability#AI Engineering#MLOps#AI Governance#Reliability
Pratik Dhanave · ·5 min read

Security and Adversarial Robustness

AI systems add attack surface that traditional security does not cover — the model, its prompts, its retrieved context, and its tools are all attackable — and the only way to know you're defended is to threat-model the whole surface and prove it with red-teaming.

AI adds attack surface conventional security misses — model, prompts, retrieved context, and tools are all attackable. Phase 7: threat-model the whole surface and prove it with red-teaming.

#AI in Production#AI Security#Security#AI Red Teaming#AI Engineering#MLOps#AI Governance#Prompt Engineering
Pratik Dhanave · ·4 min read

MLOps / LLMOps: Making Change Safe and Repeatable

The question this phase answers is simple and unforgiving — can you change the system without breaking it? — and the control you cannot skip is that no ungated change reaches users.

Can you change the system without breaking it? Phase 6: automated pipelines for code, models, and prompts, with eval gates, a registry, and automated rollback — no ungated change reaches users.

#AI in Production#MLOps#AI Engineering#DevSecOps#AI Governance#Evaluation#Prompt Engineering
Pratik Dhanave · ·5 min read

Deployment and Serving: Traffic, SLOs, and Inline Guardrails

A model that scores well in evaluation still has to serve real traffic within a latency budget, isolate tenants, plan for capacity, and enforce safety in the request path — and the guardrails have to be inline, not a filter someone can route around.

A model that scores well still has to serve traffic within a latency budget, isolate tenants, plan capacity, and enforce safety in the request path — inline, not as a filter someone can route around. Phase 5.

#AI in Production#AI Engineering#Security#MLOps#AI Governance#Guardrails
Pratik Dhanave · ·5 min read

Evaluation: Making Quality Measurable and Gating

AI systems are non-deterministic, so "it looked good in the demo" is not a quality signal — evaluation is the control system for the entire lifecycle, and if it doesn't gate releases, nothing does.

AI is non-deterministic, so 'it looked good in the demo' is not a quality signal. Phase 4: evaluation as the control system that gates every release — measurable and gating, or it's decoration.

#AI in Production#Evaluation#AI Engineering#MLOps#AI Governance
Pratik Dhanave · ·5 min read

Building the System: Compose Before You Train

Modern production AI is rarely "a model" — it is a foundation model wrapped in retrieval, context engineering, tools, and guardrails — and the biggest architectural mistake is reaching for fine-tuning before exhausting the cheaper, more reversible options.

Production AI is rarely a model — it's a composed system, and the biggest mistake is fine-tuning before exhausting cheaper, reversible options. Phase 3: compose before you train.

#AI in Production#AI Engineering#AI Agents#RAG#MLOps#AI Governance#Fine-Tuning
Pratik Dhanave · ·5 min read

Data Foundations: The Substrate Everything Depends On

Model quality is bounded by data quality, and the defects you tolerate here — poor lineage, silent drift, unmanaged PII, careless retrieval — resurface downstream as hallucinations, bias, privacy incidents, and un-auditable decisions.

Model quality is bounded by data quality; poor lineage, silent drift, unmanaged PII, and careless retrieval resurface as hallucinations and privacy incidents. Phase 2: the governed data foundation.

#AI in Production#Data Engineering#RAG#AI Engineering#MLOps#AI Governance
Pratik Dhanave · ·5 min read

Governance, Risk, and Compliance Before Real Users

Governance is the one phase whose ordering is non-negotiable: every major framework treats it as a lifecycle function established up front, and retrofitting it after an incident is how you end up with unexplainable models and regulatory exposure.

Governance is the one phase whose ordering is non-negotiable — established before real users, not retrofitted after an incident. Phase 1: NIST AI RMF, EU AI Act risk tiers, ISO 42001, and the artifacts to produce now.

#AI in Production#AI Governance#Compliance#Security#AI Engineering#MLOps#Governance
Pratik Dhanave · ·5 min read

Strategy, Use-Case Selection, and the Named Owner

The most expensive AI failures are systems that work technically but solve the wrong problem, cannot show a return, or have no one accountable when they misbehave — and all three are decided before a single model is chosen.

The most expensive AI failures solve the wrong problem, can't show a return, or have no accountable owner — all decided before a model is chosen. Phase 0: strategy, use-case selection, and the named owner.

#AI in Production#AI Engineering#AI Governance#MLOps
Pratik Dhanave · ·5 min read

Why AI Prototypes Don't Reach Production

Organizations rarely fail at building an AI demo; they fail at the gap between a working prototype and a governed, reliable, cost-controlled system — and that gap has a shape you can map.

Organizations rarely fail at building an AI demo; they fail at the gap to a governed, reliable, cost-controlled system. This roadmap maps that gap as twelve phases and a maturity ladder.

#AI in Production#AI Engineering#MLOps#AI Governance

All posts on this site are written by Pratik Dhanave, an Agentic AI Architect with 7+ years building production distributed systems, multi-agent AI platforms, and cloud-native infrastructure. About the author → Each article includes working code, architecture diagrams, and references to the specific frameworks and standards discussed. Browse all posts or explore related topics using the tag cloud above.