← Back to list

DevOps Is Not Ending. The Production Surface Changed.

Ram wanted to use AI to move faster. Siya had a harder question: what happens when this reaches production?

Clear-Text by Gnani Rahul Nutakki · 2026-05-05 03:01 · 0 claps · 3.9 min read
#devops #mlops #artificial-intelligence #kubernetes #continouslearning
Open on Medium ↗
Wiki topics: OPS · LLMOps & Inference AI · AI · General EDU · Education & Learning ☁️ · DevOps & Cloud

DevOps Is Not Ending. The Production Surface Changed.

Ram wanted to use AI to move faster. Siya had a harder question: what happens when this reaches production?

Ram is new to DevOps, but not new to the tools changing it.

He is comfortable with coding assistants, agent demos, GitHub workflows, cloud consoles, and the new wave of AI-powered operations tools. If a model can explain a failed pipeline, generate Kubernetes YAML, or draft a Terraform module, Ram wants to try it.

That curiosity is useful.

It is also dangerous if nobody reviews it with production discipline.

That is where Siya comes in.

Siya has been in enough incidents to distrust clean demos. She likes useful automation, but she asks the questions that do not fit in a launch video:

  • What changed?
  • Who approved it?
  • Can we roll it back?
  • What is the blast radius?
  • How much does it cost when traffic doubles?
  • What happens when the tool is wrong?

Ram’s question was: can AI make DevOps faster?

Siya’s question was: can we operate AI-assisted DevOps safely?

That is the theme of this series.

DevOps is not ending. The production surface is changing.

The Part Of DevOps That Is In Trouble

Some DevOps work will absolutely shrink.

Copying YAML from one repo to another. Writing the first draft of a CI workflow. Explaining a common Kubernetes error. Summarizing logs. Turning a runbook into a checklist. These are real tasks, and AI is already useful for them.

If someone’s entire value is typing commands without understanding the system, that is a fragile place to be. Ram already sees that. He is not trying to protect busywork.

“But that was never the best version of DevOps.”

The serious part of DevOps was always judgment under production constraints:

What changed?

What is the blast radius?

Can we roll back?

Is this secure?

Why did cost jump?

What does the dashboard not show?

Should this automation be allowed to act?

“AI does not remove those questions. It adds more of them.”

The New Production Surface

A normal service has failure modes we know how to name: latency, error rate, saturation, bad deploy, expired certificate, broken dependency, runaway logs, surprise cloud bill.

An AI system can fail while looking healthy.

The pod is running. The API returns 200. The GPU is busy. The dashboard is green.

The answer is still wrong,

Or unsafe,

Or too expensive,

Or produced through a tool path nobody approved.

That is a very DevOps-shaped problem. It touches release control, observability, security, identity, cost, rollback, and incident response.

The artifact is no longer just a container image. It might include code, model version, prompt version, retrieval index, evaluation results, tool permissions, provider routing, and runtime configuration.

If those pieces can change behavior, they belong in the operating model.

Why Kubernetes And GitOps Still Matter

CNCF’s 2025 survey shows Kubernetes is already a major production foundation for AI workloads. That should not surprise us. AI workloads need scheduling, isolation, rollout control, policy, networking, observability, and cost boundaries.

The details are changing.

Dynamic Resource Allocation matters because accelerators are not normal CPU requests. **Kueue matters because AI and batch workloads need fair queueing. AI Gateway work matters because inference traffic is not ordinary web traffic. KServe and llm-d** matter because model serving is becoming a distributed systems problem.

GitOps also becomes more important, not less.

For AI systems, desired state has to include more than YAML. It has to answer:

Which model moved?

Which prompt changed?

Which evaluation passed?

Which tool permissions changed?

Which rollback path exists?

“The DevOps loop does not disappear. It gets new artifacts and failure modes.”

Siya’s point to Ram was not “stop experimenting.”

It was: turn the experiment into an operating model.

That is a much calmer path.

What I Would Do First

I would start small and practical.

Use AI for read-only DevOps work first:

Summarize a failed CI job

Explain Kubernetes events

Draft a runbook from existing alerts

Review a Helm chart for obvious mistakes

Compare a Terraform plan against a policy checklist

Build an incident timeline from logs and commits

Then learn the production concepts that are becoming unavoidable:

Kubernetes scheduling and GPU capacity

GitOps with Argo CD or Flux

Helm packaging and rollback

MLOps basics: model registry, evaluation, inference

AI observability: traces, tokens, tool calls, cost, quality

Agent security: identity, permissions, audit trails

I would not begin by giving an agent production write access.

Read-only first.

Sandbox writes second.

Production writes only with narrow permissions, approval, receipts, and rollback.

If your current platform cannot explain a normal deploy, it will not explain an AI deploy.

The Real Career Signal

This series will talk about careers, but it is not only career advice.

“The larger story is how DevOps itself is changing.”

DevOps absorbed cloud. It absorbed containers. It absorbed Kubernetes. It absorbed infrastructure as code, GitOps, DevSecOps, platform engineering, observability, and FinOps.

“Now it is absorbing AI.”

Ram’s instinct is right: DevOps teams should test these tools early.

But Siya’s answer is the one I trust:

Someone still has to make these systems deployable, observable, secure, reversible, and affordable.

“That work is not disappearing, it is getting harder.”

And if DevOps has always been about making change safer, then AI is not the end of DevOps.

“AI is the next test.”

What Comes Next

Next, I want to map how CI/CD changes when the release includes not only code, but also models, prompts, evals, data, and agent permissions.

That is where this shift becomes concrete.


메타데이터
post_id
791183c0fe80
slug
devops-is-not-ending-the-production-surface-changed-791183c0fe80
url
https://medium.com/@gnanirn/devops-is-not-ending-the-production-surface-changed-791183c0fe80
canonical_url
https://medium.com/@gnanirn/devops-is-not-ending-the-production-surface-changed-791183c0fe80
author_url
https://medium.com/@gnanirn
status
ok
fetched_at
2026-07-08 02:40:31