Bringing Heart to Data: How to Measure the Unmeasurable

Bringing Heart to Data: How to Measure the Unmeasurable

How can we connect team or project activities to larger organizational goals? And how can we be sure our actions are having a measurable effect on ourselves, our partners and the world? In this blog, we share aspects of our performance measurement process so that readers can understand how we answer these questions and connect our day-to-day work to our theory of change.

Data—quantitative or qualitative—helps answer the question, “Are we having our intended impact?” Data is also a tool for holding ourselves accountable to our mission and vision, and it allows us to make informed adjustments to our approach along the way.

To determine what information matters to us as data, we work backwards from “ends” (desired results) to “means” (strategies and programs)—a practice drawn from the Results-Based Accountability (RBA) framework. With the guidance of Erika Bernabei of Equity & Results LLC, we have married the RBA framework with anti-racist principles. All of our intended results, performance management processes, and strategies are rooted in how racism—be it structural, institutional or interpersonal—as well as power and privilege shape our world and our own efforts.

These activities are part of an ongoing learning journey for us, and we still have more questions than answers, but here are a few elements of our process that may be useful:

Develop team- or project-specific performance measures, rooted in the Theory of Change

If we’re going to achieve long-term systems change, it’s important that each of us be equipped to track how our everyday actions and their results are potentially creating change. It can sometimes be difficult for core operations, like our finance or accounting teams, to connect the dots between their work and the overarching mission of the organization. We developed individual sub-theories of change for each body of work, so that every team could see the relationship between their team-specific performance measures and our overarching shared result. Developing theories of change for each team also helps visualize and reinforce how their mission-critical work is directly linked to our results. And it shows how the organizational operations performance data (e.g., staff engagement, hiring and departure data, procurement spending, and more) are critical for decision-making, particularly as we embed anti-racist principles in our operations.

Gather qualitative data at every opportunity

Some of our activities can be easily quantified. We can track how many events we hosted for partners and how many resources we created. But because our ultimate goal is building and applying skills to uproot racism in ourselves and our institution, and equipping partners and grantees to do the same, we must track and measure subtle shifts in behavior that aren’t easily quantified. Things we track include changes in the quality of our relationships, the culture of our organizations, and our personal capacity to take risks and use our power in strategic ways.

To capture these things with discipline, we’ve had to treat anecdotes and stories as invaluable forms of data, and draw patterns and themes to understand how changes are taking shape over time. For example, a central part of our theory of change is challenging and replacing harmful elements of white supremacy culture in our relationships and working dynamics. Whether we’re achieving that result is only captured by tracking peoples’ experiences. Did people actually feel something different because of our actions? Over time, these anecdotes can be threaded together into larger stories of impact that connect our efforts to outcomes, as we’ll discuss further in a future piece.

Another way we’ve captured qualitative data is by using a “check-in question” at the start of a meeting to source participants’ attitudes or experiences of something. For example, in a conversation about our results over a quarter, we might open the meeting by hearing one word or phrase from each participant about how they’d describe our impact. The resulting “Word Cloud” can illustrate the intangibles around how we’re working. Comparing Word Clouds over time can reveal interesting qualitative changes.

When we’ve presented or reported on data to all staff, we’ve asked people to share one word that captures how they feel about performance management work at Living Cities. Then, we’ve compared the resulting “Word Clouds” over time to see how sentiments change.

Track relationships at all touchpoints

Closing racial income and wealth gaps will require undoing harmful power dynamics, and changing the way that we relate to one another. Therefore, building relationships that allow us to connect to one another’s humanity, grow, and challenge and be challenged by partners is one of the most important things we can do in service of our results.

But we quickly realized that nurturing relationships over time can be hard to boil down into metrics without losing the richness of human interaction. To help meet this challenge, we developed a system to more easily allow staff members to share experiences from events, important meetings and conferences, where much of our relationship-building occurs. Staff can submit a Google form that asks them whether key relationships were formed or deepened, whether their results were achieved, whether they gained any important insights, and if they noticed any examples of our organizational influence. These takeaways become data that all teams can use.

Our performance management is an ever-evolving process. But we know that remaining grounded in our theory of change, and seeking ways to increase our accountability to our intended results, will ensure that we are continuously moving closer to our vision of a better world.

Facebook
Twitter
LinkedIn
Email

Latest Articles

Living Cities Selected to the ImpactAssets 50 for 11th Year in a Row

Living Cities’ Capital for the New Majority team is thrilled to announce that Living Cities and the Catalyst Family of Funds have been selected to the ImpactAssets 50 (IA 50) for the eleventh consecutive year and named as an Emeritus Impact Manager for the second time. “Now in its eleventh year, the ImpactAssets 50™ is the most recognized free database of …

Founders First’s Innovative Financing Supports Entrepreneurs of Color

Kim Folsom knows what it means to be a Black woman entrepreneur. Even after founding and running seven successful businesses, she still feels “like a square peg in a round hole,” she says. Yet Folsom is representative of what it will take to use capital in innovative and transformative ways to create broader systems change. Her latest venture, Founders First, …

Pulse Checking Progress Toward Operationalizing REI: Arts, Culture & Healing

In 2017, we released an internal learning report titled  “What Does it Take to Embed a Racial Equity & Inclusion Lens?” that captures themes from internal interviews, a field scan, and learnings from our grantmaking and investments in cities across the country. There were twelve themes we uncovered in our scan of practices being used by organizations to operationalize racial …

Pulse Checking Progress Toward Operationalizing REI: Shifting Systems Of Power

In 2017, we released an internal learning report titled  “What Does it Take to Embed a Racial Equity & Inclusion Lens?” that captures themes from internal interviews, a field scan, and learnings from our grantmaking and investments in cities across the country. There were twelve themes we uncovered in our scan of practices being used by organizations to operationalize racial equity.These …

Get Updates

We want to stay in touch with you! Sign up for our email list to receive updates on the progress we’re making with our network of partners, as well as helpful resources and blog posts.

Name