[p2pu-dev] P2PU Homepage

Dan Diebolt dandiebolt at gmail.com
Thu Nov 3 03:05:04 UTC 2011


>What needs to be changed? What needs to be removed?

Read till end.

There was an interesting post on Reddit today from an intern at the Khan
Academy on the subject of using "*Machine Learning to Assess Student Mastery
*". While repetition and testing is not the paradigm P2PU uses, it is
interesting to see the level of mathematics (logistic regression) being
applied to assess student proficiency at Khan. In the results section of
the post, A/B testing was mentioned as being used to evaluate different
math models for calculating learner proficiency. This apparently isn't the
only area where A/B testing is used at Khan to drive decisions.

To put A/B testing in perspective of web site design decisions, check out
three slides in this presentation starting on slide 7 where two different
registration forms are presented:

http://www.slideshare.net/slideshow/embed_code/3296257?startSlide=7

Well apparently Ben Kamens - lead dev at Khan - is using a A/B testing
framework at Khan:

https://github.com/kamens/gae_bingo

This framework makes it dead simple to inject alternatives into the Khan
platform and to automatically collect data from a sample of users
concerning which alternative has the better outcome or metric.

This framework runs seamlessly on Google's App Engine (Khan runs on App
Engine) but is allegedly framework agnostic (works with webapp, Django,
Flask, whatever).

So to comment on the original question "*What needs to be changed? What
needs to be removed?*" it would be very interesting and cutting edge to
answer some of these questions based on live A/B testing of the P2PU
platform.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.p2pu.org/pipermail/p2pu-dev/attachments/20111102/c7da3685/attachment.html>


More information about the p2pu-dev mailing list