Thriving in Chaos

Thriving in Chaos

A Narrative from NeGD (National e Governance Division)

Chaos is a daily affair in NeGD. A team of tech enthused bureaucrats and young IT professionals NeGD, has been conceived as the implementation agency of MeitY and a tech advisor to different ministries and states on various issues elevating to e Governance. Working on last minute requests. (must to be accepted), complex problem statements of project and technology management, decisions and work practises inspired by corporate work culture, in government setup are normal in NeGD

Since 2025, the nature and scope of chaos, in this small and innovative organisation has changed everything. Emergence of AI in SDLC has created more threats and less opportunities, at least in the initial stages of understanding and implementation. Expectation of AI integration in work process of project management and solution development has become a challenge in the context of hiring of higher priced skilled resources, reskilling of existing resources, development of compatible organisational policies for tools usage, continuous learning framework and procurement. Transforming this challenge into opportunity of faster turnaround of projects resulting in lower cost for client and better code quality is itself a project in making.

On the client side, AI leads to rapidly shifting client expectations. Backed by AI generated ideas ( rarely tested in Indian ecosystem) and half knowledge of AI usage in IT Sector, client often want more than agreed upon in half the time.

On top it everything, the goal of organizational transformation (from a event driven organisation to AI First IT organisation) compounded the turmoil as NeGD moved from hierarchical bureaucracy toward agile, outcome-driven ways of working, with deputation officers returning to parent cadres and contract professionals seeking greater autonomy. Requirements changed weekly, timelines compressed via directives, budgets stalled, working on holidays and the massive Gantt chart became obsolete. The rigid machine is fracturing under AI disruption, evolving citizen and State demands, and internal cultural shifts.

To handle this chaos and turmoil, the recent experiments and experiences of the Program Management (PM) team is presented in this writing as lighthouse to understand, experiment and evolve. Discussions with colleagues in government and friends in corporate sector revealed that such chaos, in one form or other is there in every organisation. The problem of NeGD is more acute as it is working as a corporate entity in government setup. To manage this chaos in NeGD, we need special skills and plan. This article delves into such 3 core ideas of managing chaos in IT Projects.

In the age of AI, projects should not be treated in mechanical way ( coding, testing and deployment problem). A Project should be seen as organic (living) unit of people, technology, processes, expectations and outcomes. Project should be seen as a complex adaptive system (CAS), a dynamic network of interacting “agents” (people, teams, AI models, citizens, client). CAS works on the following principles which must be embedded in the DNA of the organisation.

o Diverse Agents with Local Information: Each agent acts based on its immediate environment and partial knowledge, not global oversight.

o Simple Rules: Instead of thick rulebooks, a handful of guiding principles govern behavior (e.g., “deliver citizen value every two-three weeks as small wins”).

o Self-Organization: Order and coordinated action arise naturally from local interactions without central command.

o Emergence: Novel, valuable patterns and solutions appear that no single planner could foresee (e.g., unexpected service integrations that delight users).

o Feedback Loops and Non-Linearity: Small changes can trigger large, disproportionate outcomes; positive and negative feedback drives continuous adaptation.

o Adaptation and Co-Evolution: The system and its environment evolve together in response to change.

o Edge of Chaos: The sweet spot between excessive order (rigidity, stagnation) and total disorder (collapse). Here creativity, learning, and resilience are maximized.

In traditional IT project management, chaos from shifting requirements, AI unpredictability, stakeholder demands, and organizational change is fought with more plans and controls, often leading to failure, delays, and wasted resources. CAS thinking flips this : it treats chaos as a natural source of innovation rather than an enemy.

Practically, CAS has been proven highly effective in complex IT environments because:

• It enables rapid adaptation to volatility (client demands or AI model drift) without constant re-planning.
• Self-organization and emergence reduce bottlenecks, empower teams closest to the work, and surface innovative solutions faster.
• Non-linearity turns small experiments into major breakthroughs, lowering overall risk and cost over time.
• Operating at the edge of chaos builds antifragility — the system actually improves under stress, as seen in successful Indian digital platforms.

Studies and real-world cases show CAS-based approaches deliver 20–40% faster value realization, higher stakeholder satisfaction, and greater resilience compared to waterfall or rigid agile in highly uncertain settings.

In terms of effectively using AI for achieving organisational goals, CAS thinking means treating AI not as a fixed tool but as a new agent that amplifies interactions, while client feedback and organizational shifts act as constant perturbations. This also means replacing voluminous rulebooks with lightweight guardrails, preserve optionality through multiple experiments, and encourage self-organization among cross-functional squads involving NeGD, States, and citizens.

In modern VUCA ( volatile, uncertain, complex and ambiguous) world, comfort with complexity at both organisational and individual level is must. Knee jerk reactions to complex problem only leads to more chaos. To this end, tools like Cynefin framework as a diagnostic tool for navigating domains of complexity. This framework breaks the complexity into four domains and prescribe a well researched and test approach to handle that complexity.

Practically, teams can map risks weekly using AI dashboards, shifting from Disorder (common in multi-stakeholder federal projects) to Complex by running safe probes. This prevents over-reliance on complicated-domain expert silos that delay responses when client expectations or AI behaviours shift unexpectedly.

Cynefin’s effectiveness in government IT is well-documented in public-sector applications worldwide: policy-making, emergency management, agile software development, and crisis response. In NeGD, it directly addresses federal complexity, AI unpredictability, and client-driven volatility by ensuring the response matches the context — no more forcing linear plans onto emergent realities.

To bridge human elements with CAS and Cynefin, Design Thinking as the essential mindset. Developing a design thinking mindset in organisation ensures that hope, aspirations, fear and ( team, client, citizens) is always on the right track. At the end of the day we should not forget that IT projects are designed and delivered by humans for humans. Technology is just the medium.

In the Complex domain of Cynefin, where cause-and-effect emerges only in hindsight, Design Thinking provides structured yet flexible “probes.” It counters the unpredictability of AI behaviors, federal stakeholder conflicts, and rapidly evolving citizen expectations by focusing on human needs rather than rigid specifications. In wicked, multifaceted problems typical of e-governance (digital divide, linguistic diversity, privacy concerns), it promotes co-creation, reduces assumption-based errors, and turns chaos (continuous requirement changes) into a source of innovation. Public sector research shows Design Thinking excels at “humanising” complex projects by aligning diverse stakeholders around shared citizen outcomes and fostering organic growth instead of top-down imposition.

Rooted in empathy, it follows five principles: Empathize (understand citizen and State pain points deeply), Define (reframe shifting problems), Ideate (generate diverse options), Prototype (build fast, low-fidelity versions), and Test (iterate with real users). In e-governance, it counters client chaos by turning continuous requirement changes and compressed timelines into co-creation opportunities. It keeps projects firmly in the Complex domain through rapid, safe-to-fail experiments. In NeGD, monthly Design Thinking sprints with citizens and State e-Mission Teams replace assumption-heavy workshops, while AI accelerates empathy mapping and prototype analysis.

Effective implementation of these concepts in NeGD require a change in approach, policies, learning systems. It requires continuous reinforcement through feedback loops, creating small wins and rewarding the passionate and performing resources. The need of the hour is to re-define the processes of project management around ideas of CAS, Cynfin and Design Thinking. To make this a reality in NeGD, we can make some ground rules for our project teams.

o Embrace CAS thinking: View projects as living ecosystems of interacting agents (including AI). Use simple rules and self-organization to harness emergence amid AI disruption, shifting client expectations, and organizational change.

o Apply Cynefin daily for situational awareness: Map decisions and risks by domain. Probe-sense-respond in Complex environments; act decisively in Chaotic spikes caused by policy or demand shifts.

o Integrate Design Thinking to navigate human chaos: Run regular empathy-prototype-test cycles with citizens and States to absorb continuous requirement changes and evolving expectations, keeping solutions grounded and innovative.

o Adopt hybrid Agile practices tailored to government: Combine iterative sprints and modular delivery with necessary compliance guardrails to enable faster adaptation without sacrificing accountability or GFR standards.

o Use AI as a responsible sensor and accelerator: Deploy tools like Samarth for real-time feedback, attractor detection, scenario simulation, and rapid prototyping — always preserving human judgment and auditability.

o Preserve optionality and celebrate safe-to-fail experiments: Test multiple paths before commitment, especially with AI integrations, to build antifragility in federal, multi-stakeholder settings.

o Measure what emerges, not just what was planned: Track interaction velocity across teams/States, blocker resolution speed, Design Thinking iteration rate, and actual citizen outcomes alongside traditional metrics.

Today, NeGD is like redesigning and upgrading a massive national digital aircraft while it remains airborne at full speed — never able to land for a complete overhaul. Engines (core infrastructure like Aadhaar and UPI) must be enhanced with AI mid-flight, wings (interoperability layers) reconfigured for new State customizations, avionics (AI models) updated in real time, and the crew (NeGD, State teams, ministries) retrained for new collaborative ways of working — all without causing turbulence that could disrupt services to 1.4 billion passengers (citizens). One misstep risks systemic failure; hesitation leaves the nation behind in a fast-evolving digital world. Success requires CAS wisdom for self-organization, Cynefin clarity to choose the right response mode, Design Thinking for human-centred adaptation, and Agile practices for iterative progress — all empowered by responsible AI as a supportive co-pilot rather than an autopilot.

ॐ असतो मा सद्गमय । तमसो मा ज्योतिर्गमय । मृत्योर्मा अमृतं गमय । ॐ शान्तिः शान्तिः शान्तिः ॥

May this Vedic wisdom bring us clarity, light, and inner peace as we navigate the beautiful complexity of life.

Satyanveshi

(Think Good, Live Well)