Back to Blog
December 3, 2024Process

What Is Agile?

Agile is an approach to building things that emphasizes iteration, feedback, and flexibility. Instead of planning everything upfront and executing a fixed plan, you work in short cycles, learn, and adapt.

The Core Idea

Traditional approach (Waterfall): 1. Spend months gathering all requirements 2. Spend months designing everything 3. Spend months building it 4. Launch and hope it works 5. Find out users want something different

Agile approach: 1. Build a small piece quickly 2. Put it in front of users 3. Learn what works and what doesn't 4. Repeat

The insight: you can't know everything upfront. Reality changes. Requirements evolve. Building in short cycles lets you adapt.

Key Principles

Individuals over processes. Focus on people and collaboration, not rigid procedures.

Working software over documentation. Ship things that work. Docs are secondary.

Customer collaboration over contracts. Work with stakeholders continuously, not just at the start.

Responding to change over following a plan. Plans are useful, but adapting is more important.

The Manifesto
Agile started with the Agile Manifesto (2001), written by 17 software developers frustrated with traditional methods. It's short - go read it.

Agile Frameworks

Scrum - The most common framework. Work in sprints (usually 2 weeks). Defined roles (Product Owner, Scrum Master, Team). Daily standups. Sprint planning and retrospectives.

Kanban - Visualize work on a board. Limit work in progress. Focus on flow. Less prescribed than Scrum.

XP (Extreme Programming) - Engineering-focused. Pair programming, test-driven development, continuous integration.

Many teams use hybrid approaches - Scrum with Kanban boards, XP practices within Scrum, etc.

Agile for Data Teams

Data teams have adopted Agile too:

Analytics sprints. Two-week cycles to deliver specific analyses or dashboards.

Iterative modeling. Build a simple model first, refine with feedback.

Continuous delivery. dbt models deployed regularly, not in big releases.

Cross-functional collaboration. Data engineers, analysts, and stakeholders working together.

But it's not a perfect fit. Some data work (migrations, infrastructure) resists iteration. Adapt the approach.

Common Ceremonies

Sprint Planning - What will we accomplish this sprint? Pull from the backlog.

Daily Standup - Quick check-in. What did you do? What will you do? Any blockers?

Sprint Review - Demo what was built. Get stakeholder feedback.

Retrospective - How did the sprint go? What can we improve?

Keep ceremonies short and valuable. Long, boring meetings aren't Agile.

What Agile Is Not

No planning. Agile still requires planning. It's just shorter-term and adaptive.

No documentation. Documentation still matters. Just prioritize working software first.

Just standups. Doing daily standups doesn't make you Agile.

Moving fast and breaking things. Agile values sustainable pace and quality.

Cherry-picking practices. Using Agile jargon without embracing the mindset isn't Agile.

Signs of Fake Agile

  • Sprints but no iteration (building the fixed plan in 2-week chunks)
  • Stakeholders only involved at the end
  • No retrospectives or learning
  • "Agile" as an excuse to skip planning
  • Metrics focused on output (story points) not outcomes
  • Ceremonies with no purpose

Making Agile Work

Actual buy-in. Leadership must support the approach, not just the label.

Empowered teams. Teams need authority to make decisions.

Real stakeholder involvement. Not just at kickoff - throughout the process.

Focus on outcomes. What customer problem are we solving? Not just what features are we shipping.

Psychological safety. Retrospectives only work if people can speak honestly.

Sustainable pace. Constant sprinting leads to burnout. Agile isn't about going faster forever.

When Agile Fits

Uncertain requirements. You don't know exactly what to build. Discovery is needed.

Changing environment. Market moves fast. Flexibility is valuable.

Complex problems. Solutions emerge through iteration, not upfront design.

Empowered teams. People have authority and trust to make decisions.

When to Adapt

Regulated industries. Some documentation and planning is non-negotiable.

Fixed scope/budget. When constraints are truly fixed, pure Agile is harder.

Large-scale coordination. Multiple teams need some upfront alignment.

Maintenance work. Not everything fits neatly into sprints.

Be pragmatic. Agile is a tool, not a religion.

Agile is one way to work. Learn about why projects take longer than expected and change management for transformations.

---

Sources: - Agile Manifesto - Atlassian: What Is Agile? - HBR: Embracing Agile

Ready to Talk Data Strategy?

Let's discuss how we can help with your data challenges.

Book a Call