Tag Archives: tools

Open Badges, wicked problems, and that thing called hope

"feather bad weather" by Erik bij de Vaate

“feather bad weather” ©2008 Erik bij de Vaate, used under CC-BY-SA

Open badges: they are so tantalizing to so many people, so full of possibility. They appear to offer so many solutions to so many different problems. They encourage us to look at old problems with new eyes. And precisely because of their dynamism, their precious novelty, we occasionally find ourselves overwhelmed with the hope that they’ll solve all of the problems. Everything.

This, my friends, this is precisely what’s at issue with introducing badges to our current social structure: recognizing that there are problems with existing acknowledgement and recognition systems. Problems that have not been adequately addressed. We need to crack that nut wide open as we begin to figure out how badges might change the game. We need to figure out what works and what’s worth saving in this new badge world. We need to look hard at the wicked problems that they might at least influence.

The issues most often raised about badges—accessibility, injustice, value, meaning, and rigor—are not necessarily about badges themselves but instead are rooted in wicked problems, the larger systemic social, political, and economic issues that surround learning and recognition. When viewed from this perspective, it’s obvious that badges are not a panacea. So, let’s be realistic in our discussions about the ability of badges to solve all issues of access, fairness, and equity: nothing so far has solved those issues and badges alone won’t do it, either. This is a known known; let’s not waste time arguing this point. Instead, let’s wrestle mightily with the all-too-familiar feeling of impotence when discussing any possible inroad to wicked problems. Because discuss them we must.

On the plus side of this discussion, here’s a tiny sample of what badges can do. They can provide markers of social and professional possibilities, they can acknowledge varying degrees of expertise in social skills, they can indicate job skills compatibility, they can evidence a variety of important learning experiences including capturing prior learning, they can demonstrate continued professional engagement, they can represent vastly different company and brand values, and perhaps most importantly, they can provide important and meaningful personal insight.

So for now, while we’re building this ecosystem together, let’s hold tight to that thing with feathers—our sense of hope, our sense of possibility—for when seeking change, particularly systemic change, odd though it may feel and sound to outsiders, optimism is a feature not a bug.

 

If you’re reading this and nodding your head, you might also appreciate this related post from Badge Alliance Executive Director, Erin Knight: More Beefs

Much more soon. carla [at] badgealliance [dot] org

 

State of the Union: Mozilla Badges

Our work within Mozilla—co-creating great open source software, working with longstanding contributors, interacting with our larger volunteer community—ties in perfectly with badges. Recognizing people for being great at their jobs, acknowledging active collaborators, encouraging folks to deepen their participation is a no-brainer for a community-built and community-reliant organization like ours. Consequently, we’ve begun to develop and pilot internal badge systems within different areas of the organization. Not surprisingly, this growing group of Mozilla badge systems is revealing itself as fertile ground for investigating the development of a variety of badge systems.

Because we work in the open, because many people might find our badging work to be useful as background research into their own work, because we’re large enough that not everyone here is yet aware of the badge design work that’s happening at Mozilla, and because a number of folks have been inquiring about where they might earn badges, I’ve gathered all the badge work that is currently underway or planned for 2013 into this single blog post.

Some Mozilla badge systems pertain directly to education and learning, some are more heavily  focused on capturing and acknowledging prior work, while others are based on encouraging greater commitment to the community. Different badges for different requirements and all of it happening under the Mozilla tent. Nice.

The list of Mozilla badges for 2013 (in very loose chronological order):

  • Webmaker badges
  • Web literacy standard badges
  • WebDev badges
  • Capture Mozilla badges
  • Webmaker Mentor badges
  • SUMO badges
  • Engagement badges
  • QA badges
  • MDN badges
  • Student reps badges
  • Creative badges
  • Affinity badges
  • Air Mozilla badges

Webmaker Badges
Many of you are familiar with the Webmaker badges that we debuted at MozFest last year. Those included mini-skill badges earned for learning basic aspects of html and css, along with badges for activities and participation at MozFest 2012. Good news! We have more planned for the coming year. In fact, I’ve just written a great shareable tweet for webmaker badges and I’ll share it here because, this summer it’s going to come true. “Coming soon: Mozilla #webmaker badges built on the community-driven Mozilla #weblitstd; assessed and awarded by peers to peers.”

No doubt by now you’re curious. “What are the peer assessed badges that I will be able to earn this summer?” Good question. Here’s what will be available: badges for remixing, HTML, CSS, composing for the web and credibility. But how did we arrive at these? There’s something more at work here, and that brings us to our next badge system.

Web Literacy Standard Badges
If you haven’t been following our work with Web Literacy, there’s still time to get in on the action. We’re working with the Mozilla community to develop a web literacy learning standard. A standard to which organisations may choose to voluntarily align. We’ve made great headway and we’ve just announced our first Web Literacy Standard draft! For those of you who need a TL;DR of this work, here’s another tweet length explanation, “Co-creating a web literacy standard w/ the Mozilla community. Addressing assessments & badges. Join us: http://mzl.la/106TtlP #weblitstd” Feel free to share that statement on your twitterstream.

Over the last month or so we’ve worked through a mountain of content to a series of areas that we’re calling strands for now. There are three primary strands: Exploring, Building and Connecting that are composed of competencies like remixing, HTML, CSS, sharing, credibility, collaboration, security and privacy. These competencies will be used as a foundation for web literacy badges. Web literacy badges that you’ll be able to earn accomplishing projects here at Mozilla, but that you’ll also be able to earn for work done elsewhere on the web. With the development of these badges we will accomplish our goal of developing a distributed learning environment as well as a distributed badging network, stewarded by an organization dedicated to keeping the web open and free. That’s hard to beat.

I’ll certainly have more to share about web literacy badges again in the future. Indeed, here are two “-quel” badge pathways posts to further explain where we’re headed with the web literacy badge work.

WebDev Stewards Badges
We were really excited to hear that the Web Development stewards were interested in issuing badges recognizing the meaningful contributions that volunteers have been making to Mozilla over the years. They had already put together some basic criteria and done some preliminary thinking about what their badges should represent and how they should be awarded. With that much work already considered, the team felt emboldened to try something new with this endeavor: working with the community to develop the designs for these badges. Considering that these badge represent community participation, it made a sort of beautiful sense to us that they be designed by community members. And so they were.

We received a number of really wonderful designs, some of which made us think hard about what we were communicating through the visual designs and some of which just made us say, “ahhhhh.” There’s much more to say about badge visual design and we’ll cover that in a future post, but I’ll note here that these designs correlate quite nicely with the subject matter that they’re meant to represent. Friends, this is no small feat. Kudos to the team on that. I wrote a bit about these before and I’ll revisit the process of getting to the final product in another post, but for now I’ll just let these badges speak for themselves. (To learn a bit more about our design process, read this fine post by John Slater.)
Screen-Shot-2013-03-08-at-1.03.43-PM

Capture Mozilla Badges
I learned of the Capture Mozilla badges through a surprise posting on Yammer. Learning about these badges was like earning a stealth badge—surprising and delightful. Mozilla team members finding ways to acknowledge their contributors in ways that are public and shareable through Open Badges. Yes! Of course, we were excited to hear about it and we reached out to Dia Bondi, who along with Sean Bolton and Dino Anderson, is endeavoring to encourage people to contribute to the Mozilla repository through recording their experiences on video, even in less than perfect ways. Knowledge permanently captured is knowledge that continues to work.

Attempting to counter the inaccurate notion that on-camera skill is required or that a lot of preparation is involved, Capture Mozilla turned to badges as a way to be able to “talk about [the] project in a way that acknowledges other people’s contributions.” The team is thinking about the next steps for Capture Mozilla badges, in particular deepen the badging structure. Dia notes that “badging will allow the project to scale.” Music to our ears. People, earn those badges!
af4cc219466a14139af53844678f4187_image_1365531174_0374

Webmaker Mentor Badges
The Webmaker Mentors group is tearing it up with their work on the Webmaker MOOC, “Teach the Web” that is taking place May through June. The team is testing out a number of theories with this work. And they’re integrating badges into their approach. They’ll be offering a series of four Mentor badges. These badges are nicely reflexive in that they reinforce the very thing they seek to recognize, because when you earn the Mentor badge, you in turn become able to review other people’s work for mentor badges. All in all, a great system that encourages community participation while also acknowledging learning and growth. By the way, these badges will also help folks ramp up for Maker Party 2013: Learn, Remix, Sharecoming to you this summer (or winter, depending on which hemisphere you call home).

SUMO Badges
SUMO badges are in the planning stages. Roland Tanglao is busy working his way through some foundational aspects of this badge system. For those of you who are curious as to how this comes together, you might be interested in taking a look at the fun google spreadsheet I’ve devised to helps folks (and myself) think through content.

Engagement Badges
With the recent Firefox OS work, it sort of makes sense that we’d want to start acknowledging peoples’ participation through badges. Emily Goligoski has been working with Chelsea as Engagement start thinking through their four proposed badges aimed at Mozillians and Mobilizers who have participated in Firefox OS launch activities: Firefox OS Events, Firefox OS Trainer, Firefox OS Launch Day and Firefox OS Core Team. It’s still early days and these may change, but suffice it to say that they’re on their way to acknowledging their contributors in a new and dynamic way.

QA, MDN, Student Reps, Creative, Affinity, Air Mozilla
We’re very much looking forward to working with these groups to implement badges. Certainly, QA, Mozilla Developer Network (MDN), and Creative are essential components of what constitutes Mozilla to the outside world. Student Reps provide some of the major firepower behind our offering.  Affinity is weighing the options about ways to acknowledge types of commitment, both financial and temporal. They’re also working hard to ensure that their badges have rigor and value associated with them. Air Mozilla is the newest kid on the badges block. This bunch represents a wide variety of potential badges emanating from Mozilla. We can’t wait to work with them to bring them to life.

Thank you!
That’s a quick summary of the groups within Mozilla who are interested in developing badges or are already in progress with them. If I’ve missed mentioning you, or if you’re interested in working on badges in your area, please contact any member of the open badges team: we’re all happy to work with you. We are deeply grateful to the Mozilla folks who have already reached out to the Open Badges team seeking new and innovative ways to enhance their communities, recognize commitments and acknowledge participation. To say that we’re excited about next steps is to significantly understate our enthusiasm. Just a quick heads up on some immediate next steps, shortly we’ll be meeting with Annie Elliott to begin thinking through metrics for Mozilla badges: another exciting avenue to explore.

And finally, a quick and specific note of thanks to David Boswell for his fantastic work with the Community Builders and Grow Mozilla teams; he and they are proving to be invaluable partners in the ongoing development of badges here at Mozilla.

More soon.

Co-constructing a framework of web literacy and badges

Two weeks ago on Thursday we held our first web literacy framework / standard conversation. We, along with interested and influential folks, are thinking through what a web literacy standard might look like and how it might be implemented.

You can read more about our first gathering on this etherpad and check out our recorded interaction here—but before you fall too much in love with that pad or deck, take a gander at this etherpad, too. Because we held another web literacy online gathering just yesterday. (By the way, if you haven’t introduced yourself in the web literacy group of the webmaker list, please do.)

Participants at both of these public interactions began to think through and converse about some of the many complex questions surrounding this effort. Things like, what do we mean by the term “standard,” and what about people who are educationally or socially underserved, or those folks who are not even on the internet? While we don’t have answers to all of these questions, we do anticipate that this communication opportunity will spur a number of lively conversations and perhaps some complex philosophical and sociological inquiries, as well. Of course we want to talk, but more importantly, we want to listen, too.

Questions we’re asking
In essence, we’re asking a number questions and we’d like your thinking on them. Here are a few that we’ve been obsessed with lately.

  • What are the basic, intermediate and advanced skills that are essential to becoming a productive participant of the web?
  • How many are necessary to produce useful competencies?
  • What are the related outcomes associated with those skills and competencies? In other words, what might those skills and competencies get you in an applied setting?
  • Can we build assessments that support and acknowledge those skills and competencies?
  • Can we build APIs that allow you to begin to use these skill and competency assessments right on your own site?
  • How can badges be designed that accurately represent those skills and competencies?
  • What sorts of badges make sense in a distributed system like this?

And another question that’s close to my heart:

  • What goes into a badge framework that will encourage other individuals, organizations, educational institutions, etc. to build upon our web literacy badges efforts so that together we construct a viable, meaningful, and valuable network of activities, assessments and badges?

Definition of terms
A lot of this work is contingent upon us reaching some universal agreement about what we mean when we talk about web literacy.* In order for us to make any headway with the development of a standard, at the very least we’ll need to be aligned in our understanding and use of this term. Also, you may hear us talk about a standard and a framework somewhat interchangeably: we’re focused on building a framework from which a standard will emerge. Our approach for the web literacy badges works similarly: we aim to construct a conceptual framework that encourages other organizations and individuals to form their own badge system nodes in this network. While we’re still figuring out how all this gels, we’re forging ahead with designing a web literacy badge system that derives its excellence from a variety of  committed, web-literacy-standards-aligned issuers contributing to it. I’ll explore this idea in detail in future posts.

Systems thinking
One of my favorite posts that I’ve written on badge system design is Building Trust Networks, Creating Value. If you have questions about how we see this all coming together, you’ll find a number of answers there. In short, that post reviews the ways in which trust networks may evolve in the Open Badges ecosystem. It also purports that a system will function at its best if trust grows right along with it: trust that is both internal to the system as well as external to the system. A slightly different way of saying that is that a system will become more resilient if trust becomes and integral aspect of its network effect. The hallmarks of a successful system include resilience and flexibility: we’re working to build those into our web literacy badge system.

How we’re getting there from here
We’ve been considering what web literacies might look like. We’ve released a preliminary set of badges based on low level achievements that can be accomplished using one of our tools. We have a killer team assembled to begin tackling incremental assessment, creating activities that are both informative and inspirational, designing badges that act as guideposts to the standard they represent, and devising possible pathways for people to get from one skill or competency to another.** We’re analyzing the best ways to make this an open standard; imagining ways that an API might be able to be useful for things like those incremental assessments.

An invitation
Over the next few days we’ll be roughing out a lightweight roadmap; there you’ll find specific dates and goals. And exciting next step will be to hold regular weekly calls to publicly investigate, evaluate, and scrutinize this work—this most definitely will be a group effort. You’re invited! Please make a point of joining us for our inaugural weekly meeting on Thursday, Feb 28 at 08:00 PST / 11:00 EST / 16:00 GMT. I’ll post more specific dial-in details when they’re finalized. Dial-in info can be found on the Web Literacy Standard Community etherpad.

We’re excited to have you join us on this journey. Together we will co-create a new web literacy standard, develop badges that reflect that standard and begin to define pathways that lead to rewarding educational, social and personal experiences.

* A quick and appreciative nod to individuals who have been ruminating on digital literacy, digital divides, and technological literacy for years.
** A foundational badge pathways post is coming within a few days. This is a lynchpin concept.


More soon.

Webmaker, games, and learning

Chloe Varelidi has been playing around with a small team thinking through how to make games hackable, free and open source. This work makes me happy. Somewhat relatedly, Greg Wilson has just written a terrific blog post about web literacy and why we need to provide pathways and tools that provide for creativity. What ties these two things together and loops in where we’re headed with Webmaker Badges is their open ended, non-deterministic approach to learning. I believe that games and game design should be deeply integrated with Webmaker.org. Why? For a number of reasons I’ll discuss here but perhaps most importantly it’s because games are typically fun. True, they’re not always fun but when they are, they can act like mental catnip.

Games present a number of opportunities for learning and tie in really beautifully with a variety of potential learning objectives, as well as outcomes.

There are a few books that point to games being effective teaching and learning tools—surprisingly tools that can have quite a positive impact upon personal perception and well-being (see Reality is Broken). And there are a number of research studies that are being focused on games. But the one thing that everyone seems to agree on is that what makes games great is the way that they provide immediate feedback, thereby diminishing the negative charge that usually rides shotgun with failure. We’re taught to avoid failure and still, failure is a quotidian occurrence. We might more commonly refer to failure as making a mistake. Yet, learning to develop resilience in response to failure (an ability that tends to make people feel happier and helps them thrive) can be quite helpful. Games can help us to do just that.

It may seem obvious that games and learning go hand in hand but here are a few reasons why I see them as intertwined. Games generally do not hit you over the head with what they’re teaching you. Nor do they often tell you why they’re teaching you something. Heck, they don’t even tell you that they’re teaching you anything at all. They don’t always provide instructions; this means that a player must discern how to play them. As Mario Herger said at the CalTech Entrepreneurs Forum: Venturing in Serious Games for Simulation, Education, and the Enterprise, “They don’t come with a 200 page manual telling you how to use them.” Players must use their own judgment about what’s important and what comes next. This also means that a player typically makes a lot of mistakes about those things—and that’s perfectly okay. In fact, it’s expected that the player will make mistakes. Mistakes are built in to the process. Intentionally. How many other activities have the user’s mistakes planned for and built into the process?

Perhaps what games teach more than anything is the value of persistence. If failure is anticipated, so is persistence. Extra lives anyone? I’d also argue that games teach the value of a community as well. What’s the use of playing a game if you can’t share it with someone else? Okay, that’s a bit of an overstatement because there are games meant to be played entirely by yourself. Solitaire is one of them. But even within solitaire you play until you absolutely can’t play anymore. And then you start again. Resilience.

Do we learn in games? Most certainly indirectly and directly as well. As mentioned earlier, we can come to understand persistence, social and moral values, community, the concept of multiple possibilities, how to assess options, the importance of planning, soft skills, hard skills—this list could go on and on and we could examine each property endlessly. But for now, let’s just consider the ways in which games provide multiple pathways to achievements despite numerous and difficult obstacles: we like a challenge.

So, what does all of this mean for Webmaker.org? A lot. There’s a huge opportunity for us to leap into the gaming boat; to set up a few challenges of our own. To ask people to not only play games, but to code games, to design and test them. Because developing a game for someone else puts you inside the mind of that someone else and encourages you to anticipate that person’s next move. And the move beyond that. And this is the nexus of playing and learning. How can you make something fun and compelling and difficult enough to excite people but easy enough for folks to win every once in a while. This is precisely what we’re aiming to do with Webmaker.

How might Webmaker Badges fit into all of this great potential? I’m guessing that some of this may appear obvious to you and I’d love to engage on that point. My next post will address how we might best integrate these two protean elements but in the interim, if you have ideas, send them my way.

Reference
McGonigal, J. (2011). Reality is broken. New York, NY: Penguin Press.

- – -
Much more soon.

Mozilla Open Badges: another take on the shape of the ecosystem

After reviewing the work from the last post, it seemed that multiple graphics that provided different lenses with which to view our efforts was the way to go. Also, we received some pushback on our view of the ecosystem from the folks at Digital On-Ramps. That’s exactly the sort of community interaction that extends and builds the conversation and we deeply appreciate it, thanks!

Now, given that excellent effort, I ask you to consider and share your perceptions of the Open Badges ecosystem, not only as we imagine it right now but as you see it in 6 months, 1 year, 3 years, etc. Aaaaand, can you imagine additional alternative credentialing occurring and what’s the state of the workforce development movement?

Okay, with that mental exercise assigned, let’s get to more visuals. First up, a slightly revised graphic showing the traditional/non-traditional vs. accredited/non-accredited landscape.

You’ll note that the confusion introduced by matching traditional/non-traditional with formal/informal is now gone. Also, there are more organizations included in this version. Thanks to those of you who provided me with information about where they saw themselves fitting, along with areas that were previously not considered, for example the entire Maker movement. While there is some clustering happening already, I anticipate that eventually we’ll need the ability to enlarge this view dramatically because there are many groups and organizations that will be heavily clustered in some areas. That said, it’s worth noting that there are some data deserts in this graphic, too—particularly in the northeast quadrant. Perhaps this is due in part to accreditation being a pretty binary achievement (more on this in another post later).

The next graphic addresses the formal/informal environment vs. standard/experimental pedagogies. It’s new and again, a rough version of where things seem to be aligning. Here I’m contrasting a somewhat old world approach to teaching including formal requirements associated with physical placement (like seat time) with the new world order linked to the anytime, anywhere learning being engendered by the rapidly proliferating self & peer based learning sites that can be found on the Web.

There are some interesting overlaps occurring particularly in the southwest and northeast quadrants, especially as we consider the influence of the Maker movement. I would love to hear feedback on whether this graphic lens makes sense of this space, as well as if splitting traditional/non-traditional from formal/informal resonates with the community. For me, these are two different approaches that have been traditionally tightly interlaced but one that the web now compels us to recognize as potentially separate actors in the system.

By the way, if you click on these graphics, they’ll open in a new window in a larger format so you can view them more readily.

As I mentioned earlier in this post and last week’s post, I will be following up these thoughts with visuals that explain the direction that a trust network may take once Open Badges hits them. Until then, please provide your thoughts on these interpretations or directions you’d like to see expressed in a more graphic fashion.

And  lastly, thanks for all of your feedback on the graphics and ideas in the last post. I mention this frequently, but since it underpins everything we’re doing with Open Badges—and really, Mozilla in general—I’ll mention it again: you, the Open Badges community, are an essential part of building this ecosystem. All of your questions, notes, comments, RTs, likes, concerns, etc. inform the process. So, thank you and please continue to send them our way.

Much more soon.

Badge System Design: what we talk about when we talk about validity

Every day we conduct conversations with folks new to the idea of Open Badges. Each of these conversations is steeped in inquisitiveness. Questions abound. Curiosity spills out. Thought waves feel palpable. Sometimes we’re lucky enough to share the moment when the light goes on. That time feels magical, full of promise. That moment illuminates the room with the thousand-watt possibilities of the Open Badge initiative. The “what if” moment is something that should be experienced by everyone.

In some ways, the Open Badges team is continually explaining what we do—and not only what we do but why we do the things the way we do them. This constant questioning could affect us in a few ways: we could hunker down and stick to our prepared statements, we could challenge the folks who question our work, or we could listen closely to these queries and try to parse the spaces between the words, the silent places where no content yet exists. These interregnums help us to interrogate our own understanding of Open Badges. It’s probably fair to say that we do all of these, yet we try to keep focused on the last of these techniques because they provide the greatest opportunity for growth—not only for us but for our conversationalists as well.

The question of validity is posed fairly commonly.* It goes something like this, “How can we ensure that the badges have a sense of validity?” or “Who will vet them?” or “How will we know that they’re worthwhile badges issued from reputable sources?”

There is a good deal of subtext embedded in these seemingly simple questions. And bound into that subtext is an unwitting/unacknowledged acceptance of the sociocultural status quo. That tacit acceptance should be unpacked and considered. How does any organization achieve validity? How do standards become standards? When the landscape is unknown, how do you learn to trust anything?

Validity
Validity addresses the question of representational accuracy: does something perfectly represent the thing it’s allegedly designed to represent? In the case of Open Badges, the question of validity quickly becomes multifaceted. Questions that have arisen include the following:

  • Does a particular badge represent appropriate learning?
  • To whom is the badge meaningful?
  • Does the issuer have the authority to issue a particular badge?
  • Does the earning of a badge indicate that the learner has learned?
  • Does the earning of a badge indicate that the earner has been accurately assessed?

To bring a different perspective to these questions, let’s replace the word badge with the word class. This should provide some insight into how much our unquestioning acceptance of the status quo affects our acceptance of learning validity.

  • Does the taking of a particular class represent appropriate learning?
  • To whom is the completion of a class meaningful?
  • Does anyone have the authority to teach a particular class?
  • Does the completion of a class indicate that the learner has learned what they were supposed to?
  • Does the completion of a class indicate that the learner has been accurately assessed?

This simple exercise exposes our somewhat complicated relationship with understandings of validity with regards to existing institutions. Taking this a step further, imagine if the rules in an educational system were entirely reconsidered, to wit:

To demonstrate the power of rules, I like to ask my students to imagine different ones for a college. Suppose the students graded the teachers, or each other. Suppose there were no degrees: you come to college when you want to learn something, and you leave when you have learned it. Suppose tenure were awarded to professors according to their ability to solve real-world problems, rather than publishing academic papers. Suppose a class was graded as a group, instead of as individuals. (Meadows, 1999, p. 14)

Did those questions shift your perspective? I know that they resonated deeply within my consciousness. They’re the equivalent of “what if everything you knew about education were turned on its head?” questions. They’re disorienting in the best possible way. And they lead me to humbly suggest that in place of questions about validity—or at least hand in hand with these sorts of questions—we might consider asking questions about credibility and reliability, too. These areas seem to be more readily delineated and a tad more easily unpacked.

Credibility 
Credibility inspires belief and is derived from perceptions of trustworthiness and expertise. These things can be assessed through personal means but quite often are accepted tacitly. How so? Through the cultural shorthand of pre-existing standards. We countenance many sociocultural values with little to no deep consideration, i.e., everyone was doing it, I just followed the crowd, etc. Let’s consider some ways that we might be able to classify what we mean when we talk about credibility.

Expanding the idea into a taxonomy, B.J. Fogg proposes the following four types of of credibility: presumed, surface, reputed, and earned (Fogg, 2003). Presumed credibility arises from “general assumptions in the mind of the perceiver,” Surface credibility from “simple inspection or initial firsthand experience,” Reputed credibility occurs through “third-party endorsements, reports or referrals,” and Earned credibility, perhaps the most important in a new system, stems from “firsthand experience that extends over time” (Fogg, 2003, p. 131).

While we can negotiate the definitions, this basic structure brings order to the chaos of credibility, and it helps to elucidate our complicated understanding of validity. This categorization also allows us to interrogate the credibility of existing systems, and in particular, the formal system of education currently found within the United States. Here’s where Open Badges provides us an opportunity to intervene in a significant system.

Reliability
Reliability might be considered the replicability quotient of an event, idea, performance, etc. Something that can be consistently measured is considered reliable. The Open Badge Infrastructure is most certainly a reliable tool: it will produce badges that hew to its standards. However, the badge systems that are produced with that tool or housed in that tool may prove to be reliable, but then again, they may not. And yet, this dichotomy is true of any tool. In the right hands, bad tools can produce good results and in the wrong hands good tools can produce bad results. Skill is necessary and happily, it can be learned. From a systems standpoint, the US education system is also just such a tool, producing “products” of varying completeness and quality. This perceptual double standard should inform our questioning of new systems, especially one as reconstructive as Open Badges might prove to be.

The known and the unknown
There are many questions that the Open Badges initiative seeks to answer and many more that its implementation raises. Right now, we’re completely comfortable operating in the liminal space between the known and the yet-to-be-discovered, the present and the future, the understood and the ambiguous. The design of the Open Badge Infrastructure offers solutions to a number of questions regarding validity. For other questions we should ask ourselves, what is the purpose of this query? Am I expecting an answer that will only serve to reinforce a complicated and difficult but familiar system? We do ourselves a disfavor if we accept the current state of affairs without asking ourselves the following: “What exists here now?”, “What is worth keeping?”, and “What can be improved?” Those are precisely the questions that Open Badges Issuers, Earners and Displayers seek to answer themselves.

- – -

More soon.

references
Fogg, B. J. (2003). Persuasive technology. San Francisco, CA: Morgan Kaufmann.
Meadows, D. (2008). Thinking in systems. White River Junction, VT: Chelsea Green Publishing

For now let’s skip the reasons as to why this question arises from some audiences more than it does others. Although I’m happy to discuss it if you would like—you simply have to ask and away we’ll go.

Badge System Design: beyond a binary approval system

For those who labor long and hard to craft good and just standards, as well as those who have suffered from their absence. On the one hand, the fight against the tyranny of structurelessness. On the other, the fallacy of one size fits all  (Lampland & Starr, 2009).

This book dedication found in Standards and Their Stories captures the inherent paradox of badge system design. By seeking to standardize the process we risk the introduction of systemic rigidity. And yet by developing badges without a plan we risk the possibility of ideological entropy. In my writing about this topic I’m attempting to walk the middle path: somewhere in between fanatical dictums and a mad free-for-all. I wish I could say that it was easier than this, but then I’d be lying.

The status quo
Even while we’re in the midst of talking about a potentially reconstructive idea like Mozilla Open Badges, I still rather rotely refer to my own typically conventional educational route with “my undergrad degree this” or “my grad degree that.” Perhaps this is to be expected. It certainly hearkens to one of the issues that the open badges in the wild will have to confront: the seeming intractability of the status quo. In the Open Badges world this desire for stability echoes within the repeated request for a standard method of validation; it’s mated to a deep concern about badge quality. In unfamiliar situations such as these we tend to rely on current cultural understandings and touchstones. In this case, degrees and certificates, accreditation systems and educational rankings.

The status quo of our formal academic system has transmogrified into a sort of binary approval system. You pass or you fail. You go to a respected school or you go to a second-tier school. You graduate or you don’t. It all seems pretty inexorable. We gravitate toward that which is customary. The familiar often appears to be less threatening than the entirely unknown. Indeed, there is a robust academic research field that studies this tendency, especially with regards to our proclivities toward risk and reward: behavioral economics. (For a deep and delightful dive on this read Dan Ariely’s Predictably Irrational.)

Resonance
I’m hoping that some day people will refer to not only their formal schooling but their non-traditional learned experiences as well (hopefully badged in the open way) without speaking of one of them as second-rate or less than the other. That noted, I’ll return to my rather classical undergraduate education to make a point. I double-majored in graphic design and writing. The classes I took in design inform a significant amount of the way that I think. This is not to say that every design class I took made sense or built on every preceding design class so that one day I had taken enough of them to—ta-dah!—be called a designer. On the contrary, I gleaned information from a variety of sources. My deep learning occurred in many different venues, a bit of it very much outside the realm of what typically would be called design. Nevertheless, some aspects of design that I learned in those college classes continue to reverberate within me.

One of the most resonant aspects of those years pertains to users and audiences and owners and consumers and interested parties and even uninterested parties. The idea of multiple audiences pulses within me at the root. Akin to that concept, another: juxtaposition. What is there versus what is not there; what has been asked versus what has not been asked; the solid versus the void. Good designers are problem solvers, not stylists or skinners. They interrogate situations and ask why? They poke around in seemingly unrelated categories. They consider the complicating factors of temporality and fickle end users while acknowledging that a problem owner requires resolutions. They know that solutions can have many audiences and that things that seem simple and straightforward can be damn complex. (Massimo Vignelli has spoken eloquently on this subject in Massimo Vignelli on Rational Design.” Actually, read all the interviews on Steven Heller’s Design Dialogues site.)

Hard questions
Why do I mention all of this? Because as you begin the process of badge system design, you, too, will be delving into these areas. You, too, will be learning to act as a designer. You’ll be gathering information from many sources—no doubt a few of them entirely unexpected. And most likely you’ll find yourself asking deep and sometimes existential questions. I encourage you to remain open to the idea that periodically, like the question, the answer will prove to be both complex and difficult and very much not binary. Sometimes you will have to try something to know if it works because there will be no answer until you do. Accept this. Your badge system will benefit from this sideways approach. That is, believe it or not, the middle path.

- – -

Much more soon.

references
Ariely, D. (2008). Predictably Irrational. New York, NY: Harper Collins.
Lampland, M. & Starr, S. L. (2009). Standards and their stories. (p. dedication). Ithaca, NY: Cornell University Press.
Vignelli, M. (1998). Massimo Vignelli on Rational Design. In Heller, S. (Ed.), Design dialogues (pp. 3-8). New York, NY: Allworth Press.

Learning, coding, systems of power, and Mozilla

Starting this summer, we’re aiming to help create a group of webmakers. Building on Mozilla’s Manifesto—to promote openness, innovation and opportunity on the web—we’re rationalizing a set of core skills, developing learning objectives and outcomes associated with those skills and offering opportunities to try them out. This effort aligns extremely well with the development and promotion of #5 in our mission list: “Individuals must have the ability to shape their own experiences on the Internet.”

What’s a webmaker?
What do we mean by webmaker? Someone who contributes to the web but also someone who understands the web and its inherent power. Our focus is on moving people toward doing rather than perceiving but both are required. Experimentation is where we’re headed. Guiding people toward understanding the software that constitutes the web so that they can make more informed and educated decisions about not only how they interact with the web, but how they interact with the systems that lead to the power of the web. Yes, systems as we’ve been discussing in previous posts. (Avoiding the complex discussion of Foucault’s systems of power for now, thanks.)

Code is political
Code is political. While that may seem to be a polemical statement, it’s one that serves to inform the currently omnipresent drive to teach people to code. Code is enveloped in systems of power—systems of power that will increasingly play large roles in people’s lives. Understanding that you can create as well as consume seems a fair balance. More people having a literacy is something to be desired, not shunned or disdained. (More info here: Lawrence Lessig’s Code is Law)

What do we mean by literacy?
Traditional literacy lifts people out of poverty, modifies their worldviews, opens up new vistas and provides new opportunities for further enrichment, whether they be social, political, professional, or ideological. If you want your own proof, just search with this combination of terms “literacy and poverty.” Who’s to say that digital literacy won’t accomplish similar things? In the vein of the scientific method, why not test it out?

Literacy itself is a complex term that encompasses a broad spectrum. In our case, literacy is a basic communication skill, akin to numeracy or traditional language literacy. We’re not aiming to make everyone into Joycean code experimenters pushing the boundaries of language and comprehension, nor are we aiming to move everyone toward Hemingway-esque brevity and conciseness, but if some of you decide those pathways are for you, all the better. At least you’ll be moving forward with a broader understanding of what’s possible. And you will be making the decision for yourself, not having it handed to you by some faceless mega-corporation.

Our initial take on web literacy skills is bouncing along as an ongoing experiment (sounds familiar, right?). In the same vein as iterate often, we’re out there trying things on, seeing what feels right. Working with other organizations to leverage their understandings of web literacy and expand upon our own.

What we’re interested in doing with webmaking is shining a light into a place you may not have considered looking before. Showing you that that place is not full of monsters, is not incomprehensible, but is instead simply the exact same world you’ve been experiencing all along just translated into another language. Learning to code is a deciphering of sorts—a decoding of symbols. It offers a different lens through which to view the world.

Opportunity
This new knowledge lens may significantly alter the way you perceive the world; it’s hard to say how it will affect you. Perhaps that unknown quantity is precisely why Mozilla believes learning to code is something everyone should be afforded the opportunity to learn how to do. The operative word in that sentence is opportunity.

Knock, knock, knock.

Open Badges & Badge System Design

Over the last few months I’ve been doing a lot of thinking about Open Badges and badge system design. During that time I’ve found myself weighing the idea of the Open Badges Infrastructure against the idea of Open Badges. I’ve come around to this thinking: one is a subset of the other. Open Badges is an umbrella concept about perception, achievement, learning, representation, assessment, and value that has produced the tool that is the OBI. Perhaps the OBI is an epiphenomenon of the conceptual work of Open Badges. OBI is to tool as Open Badges is to process. It’s a bit chicken/egg but as we progress the temporal distinction seems to matter less and less.

OBI the tool is designed to be agnostic, but Open Badges the concept presents opportunities for transmission of deeply held beliefs, strong opinions and decisive values about learning, education, agency, creativity, dynamism, change, and evolution. I’m racing through these important and defining ideas right now because I want to start sharing some initial thoughts about badge system design. But I’m happy to have this discussion in greater detail with you on this blog, on twitter, through emails, during calls, and if we’re lucky, in person. You have helped us and continue to help us build this amazing tool; now let’s talk about what we can do with it as well as what we want to do with it.

Serendipitously today after I had already written the few intro-type paragraphs below, I saw a tweet that lead me to download and read a highly influential systems design paper Leverage Points: Places to Intervene in a System. As I read this inspirational document by Donella Meadows I grew increasingly excited: on my own I had arrived at similar realizations and had used nearly the exact terminology as she had in her paper. Those clues indicate to me that I’m on the right track. To that end, I’m dispensing with the many revisions I usually go through for a blog post and instead dropping in my initial rough draft to share it with you while the ideas are still messy and fresh. I don’t want to overthink them—at least not right now. Let’s begin our conversation now before the ideological badge cement has hardened.

Open Badges offers thousands of possibilities to those who choose to participate. I want to help you see what those amazing opportunities might be. Here’s my humble request: be my reader and my co-author on this journey.

- – -

Badge system design presents a variety of exciting challenges and opportunities. In some ways, it’s similar to designing the perfect society, one in which important things are recognized, feedback is welcomed and used, individuality is respected, people are encouraged to express themselves freely and creatively, expand their potential, attempt difficult but rewarding experiences, interact with and aid others, seek and find opportunities, learn, experience, make, scaffold, share and grow. Perhaps a little thinking is in order, huh?

Humility plays a key role in the design of any system, including badge system design. Your badge system design, no matter how brilliant, most likely will not end global hunger, solve the debt crisis, or fix a broken educational system. However, if created with intelligence, finesse and empathy, it may have the capacity to change someone’s life. Indeed, it may possibly help to alleviate some of those other, larger concerns.

Currently, the entire ecosystem remains an unknown quantity: how many badges will flicker on in the badge system galaxy? What will happen as it knits together? It’s quite possible that your simple designs may take on a far more complex role than you can imagine. So a few suggestions, notes, and recommendations are in order.

History is littered with lessons and examples of great ideas that went bad or never got off the ground. The human equation always introduces an element of chance. While that tendency certainly presents a massive complicating variable, ultimately that’s where the ground might be most fertile. Be fearless, investigate it.

And yet note that it might be best to start with a simple idea and let organic evolutionary properties run their natural course. Because unexpected emergent properties will occur even if you think you’ve planned for everything. Eventually Taleb’s black swan will fly overhead. Perhaps its shadow will pass by, perhaps it will skim the waters for a while and move on, or perhaps it will land and begin swimming in your happy little pre-planned badge ecosystem. Who knows?

Okay. Taking a somewhat more clinical view, some psychological research indicates that resilience contributes greatly to long term happiness. Resilience is important to a robust system. How can you build in resilience? What do we mean by resilience? Your badge system design will play some role in an earner’s sense of self. And so, like the person earning the badges you’re designing, if it’s to have a long and happy life, your badge system must have its own source of resilience. Whether that arises from the community, the planners, or the larger ecosystem does not matter.

- – -

Those are some initial thoughts. Much, much, much more to come.