Home | Carnegie Learning
Back to BlogUpGrade: An Open Source Platform for A/B Testing in Education

UpGrade: An Open Source Platform for A/B Testing in Education

We've got some exciting news to share!

We'd like to introduce UpGrade, an open source A/B testing platform for education software funded by the Bill & Melinda Gates Foundation and Schmidt Futures.

UpGrade will make it easier for educators to develop and discover the most effective learning outcomes by supporting real-time field tests. Our vision is to bring together teachers, researchers and edtech companies to design “A/B tests” of new approaches to digital learning. Our mission is to build a community of practitioners to continuously improve student outcomes -- and to contribute to the science of learning.

In the first phase, UpGrade will be introduced within MATHia, our artificial intelligence math learning software, for the 2020/2021 school year. The project is designed to be a fully open source platform and aims to provide a common resource for learning scientists and educational software companies. Our design and development collaborator, Playpower Labs, is currently using UpGrade to support learning science-based improvements in their own math games.

Why A/B Test?

 

Software companies like Amazon, Google and Facebook use A/B testing to continuously improve their products. They will assign users one of two versions of a software feature ("A" or "B") and see how that impacts user behavior. The version that promotes the most desired behavior "wins" and is then implemented.

Our goal is to take the power of A/B testing and apply it to learning technology in order to optimize student learning. For example, which version of a MATHia feature contributes to better understanding of the mathematical concept? Having this information, validated by science, will enable us to continuously improve our solutions, making them most effective for teachers and students.

What We'll Test

 

Here is an example of what an A/B test in MATHia might look like:

Which is the better model for fraction division?

 

Working together with researchers and educators, we may also explore:

  • Motivational messaging to support a growth mindset
  • Interactive tools for building conceptual knowledge
  • How optimized problem transitions can support learning
  • Providing progress feedback that is realistic but not discouraging
  • Encouraging appropriate use of hints


The Impact on Education

 

Dr. Steven Ritter, our Co-Founder and Chief Scientist, recently told The Learning Agency, "The ability to try out improvements like this will lead to more effective approaches to instruction. We are working with learning science researchers to field-test basic principles that can apply across many instructional systems."

Want updates on our work? Sign up here.

Author

  • Carnegie Learning

Carnegie Learning is shaping the future of education. Born from more than 30 years of learning science research at Carnegie Mellon University, the company has become a recognized leader in the ed tech space, using artificial intelligence, formative assessment, and adaptive learning to deliver groundbreaking solutions to education’s toughest challenges. With the highest quality offerings for K-12 math, ELA, literacy, world languages, professional learning and more, Carnegie Learning is changing the way we think about education, and creating powerful results for teachers and students alike.

Explore more related to this author

You May Like

Success Spotlight: Record-Breaking State Assessment Scores at Howard Street…
Carnegie Learning
Success Spotlight: Texas Teacher Josh Moseley Is Boosting Math…
Karen Sloan
Why Supporting Spanish-Speaking Students is Critical: 2022 Spanish-Usage Report
Natalia Álvarez-Morillo
Success Spotlight: Virtual Math Classrooms Are a Creative Solution…
Carnegie Learning
The Power of Pulse Checks in the ELA Classroom
Heather Sampselle
2023 Education Trends for a Year of Hope
Cory Armes, M.Ed.
  • June 18, 2020

"Our mission is to build a community of practitioners to continuously improve student outcomes -- and to contribute to the science of learning."

Filed Under

  • Carnegie Learning
  • EdTech
  • Future Ready
  • Research

Tags

  • Adaptive Learning
  • Artificial Intelligence
  • Math Software

Connect With Us

  • Facebook
  • Twitter
  • LinkedIn
  • Pinterest
  • Instagram
  • Privacy Policy
  • Terms of Use

Carnegie Learning, Inc.

  • 501 Grant Street
  • Union Trust Building
  • Suite 1075
  • Pittsburgh, PA 15219
  • P: 888.851.7094

© 2014-2023 Carnegie Learning, Inc.

Home | Carnegie Learning Close
  • Home
  • Solutions
    • Math Solutions
    • Middle School Math Solution (6-8)
    • High School Math Solution (9-12)
    • MATHia (6-12)
    • MATHiaU (Higher Ed)
    • Zorbit’s Math (K-6)
    • Zulama Coding (6-12)
    • Literacy Solutions
    • Mirrors & Windows (6-12)
    • Fast ForWord (K-12)
    • Bookshop Phonics (K-5)
    • World Languages Solutions
    • ¡Qué chévere!: Spanish (6-12)
    • En voz alta: Español para hispanohablantes (6-12)
    • T’es branché?: French (6-12)
    • Deutsch So Aktuell 8e: German (6-12)
    • Zhēn Bàng!: Chinese (6-12)
    • Amici d'Italia: Italian (6-12)
    • World Language Immersion (6-12)
    • Exploring (6-8)
    • Symtalk (K-5)
  • Services
    • Professional Learning Services
    • High-Dosage Tutoring
  • Why CL
    • Research & Results
    • Success Stories
  • Company
    • Careers
    • Events & Webinars
    • Press Room
    • Blog
    • Communities
  • Let's Talk
  • Blog Listings
  • Sample Center
  • Help Center
  • Customer Sign-in