Review Process

Learn about our comprehensive five-step review process and the five product categories that guide our reviewers.

The Process

Every product is examined by at least two members of the independent Product Advisory Board. Reviews are established through a five-step evaluation process applied to each courseware product.

The Process

Every product is examined by at least two members of the independent Product Advisory Board. Reviews are established through a five-step evaluation process applied to each courseware product.

The Process

Every product is examined by at least two members of the independent Product Advisory Board. Reviews are established through a five-step evaluation process applied to each courseware product.

The Process

Every product is examined by at least two members of the independent Product Advisory Board. Reviews are established through a five-step evaluation process applied to each courseware product.

The Process

Every product is examined by at least two members of the independent Product Advisory Board. Reviews are established through a five-step evaluation process applied to each courseware product.

1. Identify

We track the universe of digital learning tools to review and proactively solicit suppliers’ participation.

2. Source

Our team requests product profile information and product demo access from suppliers.

3. Review

Our team sends materials to at least two Product Advisory Board members for review, leveraging the latest review process and methodologies.

4. Feedback

Our team shares the initial reviews with the suppliers and then shares the suppliers’ feedback with the Product Advisory Board reviewers.

5. Finalize and Publish

Product Advisory Board reviewers are given complete discretion to revise their reviews based on the suppliers’ feedback. Final reviews are then submitted to the CourseGateway team, ensuring that the courseware is updated or otherwise added to the system.

Review Categories

Product reviews focus on five categories of product attributes.

Equity

Existence and quality of product attributes that promote equitable outcomes for Black, Latino/Latina, Indigenous students, and students from low-income backgrounds.

View the rubric

Research used to inform the design of the digital learning product is transparent and considers student populations by race and income.

The digital learning product uses equity-minded language.

Learning activities can be customized to embed culturally responsive and affirming functionalities.

Research is transparent and includes student outcomes evidence by race and income (e.g., case studies, quasi-experimental studies, experimental studies).

Students are consistently included and positively reflected.

The digital learning tool centers social, emotional, and academic supports that are culturally relevant and responsive, providing an affirming sense of belonging.

Efficacy

Existence and quality of research that supports a product’s effectiveness in improving students’ learning outcomes.

View the rubric

Supplier-generated case studies and qualitative studies are available across a variety of use cases and contexts.

Research is conducted across a diversity of institutional settings, and outcomes data is disaggregated across those institutional setting types.

Suppliers’ research designs and supports are available for institutions interested in pursuing research based on product-generated data.

Available research supports a product’s efficacy and leverages reliable and valid empirical methods.

Research has been conducted by a trusted third party (e.g., a nationally recognized research organization or a qualified researcher who is peer-reviewed).

Functionality

Existence and quality of product attributes that relate to instructional design and user experience.

View the rubric

The tool adjusts the presentations of content in relation to the knowledge of learners.

Students can engage with peers, mentors, or instructors as appropriate within the tool’s interface.

Instructors or course designers can alter the learning or assessment content.

The tool supports evidence-based teaching pedagogies such as active learning.

Includes support to help learners grow beyond their current level of proficiency.

Learning can be assessed in relation to learning objectives/competencies.

Software and user-centered design features support sustained engagement and high user satisfaction (across both single sittings and the entire course).

Systems Capabilities
Systems

Technical components that indicate systems compatibility, ease of implementation, and data management capabilities.

View the rubric

Easy-to-use and robust functionality allows users to create, store, and share course-related content in various formats.

Scheduling, progress support, and assignments are supported functions.

Data generated and stored by the supplier is easily available to relevant faculty and administrators upon their request.

Privacy, Data Protection & Rights
Privacy

Students' data is protected by third-party vendors and used for educational purposes.

View the rubric

Data is used in a positive and responsible way to promote data equity and ethical data uses.

Students’ data is protected, and students can decide how their data is to be shared, with no gap for Black, Latino/Latina, Indigenous students, and students from low-income backgrounds.

Reliance on third-party applications is limited, does not inhibit student learning or use, and the implications of third-party relationships are clearly outlined to students, instructors, and administrators.

Governance Board

The CourseGateway Governance Board provides guidance and strategic oversight to ensure the product review process is aligned with the overall mission and goals of the CourseGateway program. It is populated by previous members of the Product Advisory Board.

Baiyun Chen
Baiyun Chen, Ph.D.
University of Central Florida

Program Director, Personalized Adaptive Learning (PAL)

Bonnie Grohe
Bonnie Grohe, Ph.D.
Fayetteville State University

Director of Faculty Development and Online Education, Associate Professor of Criminal Justice

Dewaynna Horn
Dewaynna Horn, Ph.D.
Texas Woman’s University

Associate Dean and Professor of Management

Muhammad Hossain
Muhammad Hossain
Claflin University

Director of Instructional Technology

Valerie Jones
Valerie Jones, Ed.D.
Lone Star College

President, LSC-CyFair

Peter van Leusen
Peter van Leusen, Ph.D.
Arizona State University

Director Adaptive & Personalized Learning, EdPlus Design & Development

Erin Lynch
Erin Lynch, Ed.D.
The Quality Education for Minorities (QEM) Network

President

Candis Pizzetta
Candis Pizzetta
Jackson State University

Associate Professor, English and Modern Foreign Languages

Product Advisory Board

Product reviews are performed by an independent Product Advisory Board established specifically for the purposes of CourseGateway. View our current Product Advisory Board on the EDUCAUSE website.

 

An illustration of a group of product advisory board members reviewing courseware together.

 

The CourseGateway Story

Learn more about the CourseGateway mission and our vision for more equitable outcomes through student-centered digital learning experiences.

READ OUR STORY