OKP Learning Experience Rubric 1.1

As a part of the work I’ve been doing around opening knowledge practices generally, I’ve been thinking about how one might design open learning experiences that support multiple meanings of “open”: not just using open educational resources (OER), not just enabling open educational pedagogies (OEP), and not just offering wide access (like MOOCs), but all those meanings of open and more. To continue what is a long-standing conversation across the open community, I’ve tried to distill characteristics and levels of open into a rubric that one might use as a guide to designing and/or evaluating open learning experiences.

I know I haven’t managed to capture everything that might be considered in open learning experiences, so I hope we can together revise/extend this starting place to make it even richer. Please comment and contribute! Highlight any text on this page to add Hypothesis annotations, add comments or webmentions below, and/or contact me. I’ll be including all those who contribute in the acknowledgements (unless they prefer to remain unacknowledged).

You can explore public Hypothesis annotations people have made on this document by opening the Hypothesis sidebar at the upper right. You can also explore public annotations on any other document that are tagged with both “OKP” (for Open Knowledge Practices) and “LER” (for Learning Experience Rubric) using Jon Udell’s “facet” utility that enables sophisticated searches of annotations and replies. For example, when I’m reading other resources in the bibliography below and make annotations that I think relate to this rubric, I’m tagging those annotations with both “OKP” and “LER”.

Once the rubric starts to mature, I’d love to consider another step: a collection of learning experiences matched to the rubric. Ideally, we’d just connect to already existing collections of learning experience designs.

Scroll down to see the collaborative bibliography of works related to this topic I’ve started. It’s very sparsely populated so far, but I welcome additional contributions. Let me know if there’s a resource I should add or I’ll gladly add you to the collaborative group I started in Zotero.

The Rubric

This rubric is designed to evaluate open educational learning experiences (eg, assignments, modules, courses, etc). The components of the rubric may seem vague and/or overly general as I have been attempting to make something that can be used in different situations. I’d love to hold up more specific open characteristics, materials, activities, etc to see if the rubric can include them.

The columns are additive: For a learning experience to be Developing, it should also include Emerging characteristics. Transforming experiences should also include Developing and Emerging characteristics.

Please comment and contribute! Highlight text to add Hypothesis annotations, add comments or webmentions below, and/or contact me. I’ll be including all those who contribute in the acknowledgements (unless they prefer to remain unacknowledged).

You can also access a Google Slides version of the rubric that can be downloaded in various other formats, including a PDF suitable for printing.

Emerging Developing Transforming
Portable skills Training and practice in required skills are integrated into the experience. Participants practice skills that would be valuable for them beyond the experience. Participants apply skills in new situations outside the experience.
Renewable work Participants produce works connected to existing works that have value in the world. Participants modify and/or add to existing works that have value in the world. Participants produce new works that have value in the world.
Engaging openness Participants engage with open materials and/or activities (eg, open data, open educational resources, open-source technologies, etc). Participants apply open practices and/or tools to closed materials and/or activities. Participants engage directly and productively with new or existing open projects and/or communities.
Ensuring inclusivity Materials and activities support and encourage access and use by diverse participants. Participants modify/extend materials and activities to enable better access and use within the experience. Participants modify, extend, and/or promote materials and/or activities to engage communities outside the experience.
Exploring roles & relationships Roles and relationships shared among participants and broader communities are clearly surfaced and discussed. Participants explore different roles and relationships like learning/teaching, receiving/giving, observing/making, consuming/producing, autonomy/interdependence, freedom/responsibility. Participants empower themselves and others to take on new roles and relationships outside the experience.
OKP Learning Experience Rubric 1.1

Rubric Contributors

Bibliography: Open Learning Experience Design

Resources listed below are items in the larger, public Open Knowledge Practices Zotero group bibliography that appear in the subcollection, Learning Experience Bingo.

Let me know if you have a resource to add to this bibliography or send me your email address if you would like to join the collaborative Zotero group to add and tag resources yourself.

Bali, Maha. “Curation of Posts on Open Pedagogy #YearOfOpen.” Reflecting Allowed, 21 Apr. 2017, https://blog.mahabali.me/whyopen/curation-of-posts-on-open-pedagogy-yearofopen/.
Bali, Maha. “What Is Open Pedagogy? #YearOfOpen Hangout April 24.” Reflecting Allowed, 20 Apr. 2017, https://blog.mahabali.me/whyopen/what-is-open-pedagogy-yearofopen-hangout-april-24/.
Baroud, Fawzi, et al. “What Is Open Education?” Year of Open, https://www.yearofopen.org/what-is-open-education/. Accessed 2 Dec. 2019.
Cormier, David. Open Pedagogy – A Three Day Seminar at Digital Pedagogy Lab. 24 Mar. 2019, http://davecormier.com/edblog/2019/03/24/open-pedagogy-a-three-day-seminar-at-digital-pedagogy-lab/.
Cronin, Catherine. “Openness and Praxis: Exploring the Use of Open Educational Practices in Higher Education.” The International Review of Research in Open and Distributed Learning, vol. 18, no. 5, Aug. 2017, http://www.irrodl.org/index.php/irrodl/article/view/3096.
DeRosa, Robin. “Open Pedagogy: Quick Reflection for #YearOfOpen.” Actualham, 24 Apr. 2017, http://robinderosa.net/uncategorized/1775/.
DeRosa, Robin, and Rajiv Jhangiani. “Open Pedagogy Notebook.” Open Pedagogy Notebook, 16 Mar. 2018, http://openpedagogy.org/open-pedagogy/.
Hodgkinson-Williams, Cheryl Ann, and Henry Trotter. “A Social Justice Framework for Understanding Open Educational Resources and Practices in the Global South.” Journal of Learning for Development - JL4D, vol. 5, no. 3, Nov. 2018, http://jl4d.org/index.php/ejl4d/article/view/312.
Inamorato  dos  Santos, Andreia, et al. Opening up Education: A Support Framework for Higher Education Institutions. Text, Publications Office of the European Union, 27 July 2016, p. 78, https://ec.europa.eu/jrc/en/publication/eur-scientific-and-technical-research-reports/opening-education-support-framework-higher-education-institutions.
Lambert, Sarah Roslyn. “Changing Our (Dis)Course: A Distinctive Social Justice Aligned Definition of Open Education.” Journal of Learning for Development - JL4D, vol. 5, no. 3, Nov. 2018, https://jl4d.org/index.php/ejl4d/article/view/290.
McVerry, Greg. “Draft Framework for Effective Teaching and Higher Ed.” INTERTEXTrEVOLUTION, 1 Nov. 2019, https://jgregorymcverry.com/frameworkforeffectivehighered.
Online Learning Consortium. “OLC Quality Scorecard: Improve the Quality of Online Learning & Teaching.” Online Learning Consortium, https://onlinelearningconsortium.org/consult/olc-quality-scorecard-blended-learning-programs/. Accessed 25 Nov. 2019.
Schuwer, Robert, et al. “What Is Open Pedagogy?” Year of Open, https://www.yearofopen.org/april-open-perspective-what-is-open-pedagogy/. Accessed 2 Dec. 2019.
Wiley, David. “What Is Open Pedagogy?” Iterating toward Openness, 21 Oct. 2013, https://opencontent.org/blog/archives/2975.
Wiley, David, and John Hilton. “View of Defining OER-Enabled Pedagogy.” International Review of Research in Open and Distributed Learning, vol. 19, no. 4, 2018, http://www.irrodl.org/index.php/irrodl/article/view/3601/4724.
OSCQR. https://oscqr.org/. Accessed 25 Nov. 2019.
QM Rubrics & Standards | Quality Matters. https://www.qualitymatters.org/qa-resources/rubric-standards. Accessed 25 Nov. 2019.
Cape Town Open Education Declaration 10th Anniversary. https://www.capetowndeclaration.org/cpt10/. Accessed 1 Dec. 2019.
The Cape Town Open Education Declaration. https://www.capetowndeclaration.org/read-the-declaration. Accessed 1 Dec. 2019.

Bibliography Contributors

3 thoughts on “OKP Learning Experience Rubric 1.1”

  1. This is awesome. There is so so much to love here. First, the layering of Hypothesis does so much to make the rubric dynamic, which of course it wants to be. I have really pondered the idea of “open assessment” for a long time, and would love to see a revolution in which our assessment tools become as 5R-able as the materials they assess. So I had a bunch of questions inside the rubric, but I think I like the rubric MORE for making me question it in places. But I also love this because it helps draw conversation towards the qualities of our learning experiences outside of content, and I don’t think there are a whole lot of scaffolds for faculty who want to open their pedagogy that really help draw the focus towards how and why and a bit away from WHAT. This is SUCH a cool project. At some point, maybe do a paragraph synopsis and link back to this page and submit to the Open Pedagogy Notebook, too. I’d love to see this in there at some point.



  • Stephen Downes

Leave a Comment