Hi Jessica, <div><br></div><div>you might want to have a look at a recent presentation I gave, where I talked about the possibility of accessing external contributions and interesting ways of both providing metrics and visualizing these for research and for the participants - this is very early stuff, and some of it is quite hard, but I might be interested in working on some of this for my PhD thesis. Anyway we should definitively coordinate our work. I'd love to discuss this further with you at some point.</div>
<div><br></div><div><span class="Apple-style-span" style="color: rgb(51, 51, 51); font-family: arial, sans-serif; font-size: 13px; background-color: rgb(255, 255, 255); "><a href="http://www.slideshare.net/houshuang/open-courses-and-informal-learning-in-a-web-20-world-a-research-agenda" target="_blank" style="color: rgb(17, 85, 204); ">http://www.slideshare.net/houshuang/open-courses-and-informal-learning-in-a-web-20-world-a-research-agenda</a></span></div>
<div><br></div><div>In the meantime, the stuff you listed all looks very useful/interesting!<br>Stian<br><br><div class="gmail_quote">On Sun, Jul 31, 2011 at 10:03, Jessica Ledbetter <span dir="ltr"><<a href="mailto:jessica@jessicaledbetter.com">jessica@jessicaledbetter.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">Greetings all (and especially Karen):<br><br>Attached are some mockups of some course metrics' graphs/charts. I'd love to get feedback from everyone by Wednesday. If that's not enough time, let me know. (Karen asked about getting a way to assess courses into P2PU and these are the first draft attempts at what it could look like.)<br>
<br>We start by going to the course's admin page. Right now it's a button called "Edit Study Group" (or "Edit Course" or .. etc.) but I propose that that becomes "Administer Study Group" or "Study Group Admin" to better encompass the addition of metrics (and maybe some other stuff that's in my ideabox). Also, we'd have a link to them on the study group's sidebar in the box where Updates, Organizers, and Participant count are. <br>
<br>Not obvious by this screenshot is that I also widened the box that this is in so that it's the same width as the P2PU header. More real estate for all this will be a very good thing :) In my experimentation, I wanted even more room!<br>
<br>The first chart on the metric page is<b> "Overall Activity"</b>:<br clear="all"><br><img title="projectAdmin.png" alt="projectAdmin.png" width="420" height="282"><br>
<br><b>1:</b> Can download this graph as a graphic. This will come in handy when the graphs get too big for the real estate available or for inclusion in presentations/reports.<br>
<br><b>2: </b>When mousing over points on the chart, hint text pops up with more information. The line in this is an average of the 3 participants.<br><br><b>3: </b>Specifically for this chart, I was trying to show the "health" of the course. Missing are Task Edits, Task Creations, Page Views by Participants, Page Views by Non-Participants (this would have to be somewhere else). I can add those here too, of course. I'm not sure if Time on Page fits well with these other data points but I put it here since it was requested. Maybe another chart that is more web analytics like the page views and time could be together? I have a thought on "health" that might be better in its own email. However, I talk about it below after all the mockups ("Health Formula") :)<br>
<br><b>Overall:</b> This chart, and others, could become difficult to use with a lot of students in the course. But I can stretch it out so that you can scroll over to see it all or have a sort of zoom in feature so you can see the overall lines and zoom in on certain areas.<br>
<br>Also, I can make it so that when you click a bar that you "drill down" to see more information like <b>when </b>the activity occurred for the person.<br><br><b>Next is "Activity Over Time"</b> which is a more specific metric for health reporting.<br>
<br><img title="chartActivityOverTime.png" alt="chartActivityOverTime.png" width="420" height="239"><br>
<br>Activities listed right now are: comments, task edits, participants' last log in time, and how many tasks were added. We can add page views in phase 2. We could also have a running "total" showing as well. Requested was the ability to see by day, week, and total. Also, I can give this as a table.<br>
<br>Next is<b> "Participant Comments."</b><br><br><img title="chartParticipantComments.png" alt="chartParticipantComments.png" width="420" height="348"><br>
<br>Here we have a "total" for the day plus what each person did to contribute to this total. There would be a chart like this for all activity types so that you can see per day and total. This one is from the view of a non-organizer. The participants' names are not shown but the logged in user will be able to see his or her own place compared to others. If the viewer is an organizer, then he or she can see all names.<br>
<b><br>Question: </b>Should the organizers be listed in the charts? I think they should but just wanted to double check. You can also click a name and toggle off whether or not the person's data is shown on the chart.<br>
<br><b>Question:</b> Should the public be able to see these? Their view would not show participants' names, of course.<br> <br><b>Roadmap:</b><br><ul><li>Get feedback :) Update based on that.</li></ul><ul><li>Phase 1 would be:</li>
</ul><ul style="margin-left:40px"><li>Comments</li><li>Task edits</li><li>Task creations</li><li>Privacy policy update by John<br></li></ul><ul><li>Phase 2 would be:</li></ul><ul style="margin-left:40px"><li>Page views</li>
<li>Time on page</li><li>Last login</li></ul><br><b>Health Formula:</b><br><br>As I mentioned above, I have an idea about the "health" measurement. What if we came up with a formula that helps us see at a glance how "healthy" a course is?<br>
<br>What about putting more weight on comments and logged in user page views vs non logged in user page views. Task creation is important but a workshop-style class could have 3 tasks vs a more traditional course could have many. So this would probably be more focused on a course/study group vs a dashboard of all courses.<br>
<br><i>Perhaps:</i><br><br>Health = Number of Task Comments * 20 + Number of Wall Comments * 10 + Number of Tasks Created * 5 + Number of Page Views by Logged In Users * 5 + Number of Page Views by Non Logged In Users + Task Edits + Amount of Time in Seconds Logged In Users Spent on Page * 3 [This could be very faulty though] + Amount of Time in Seconds Non Participants Spent on Page [Still faulty but would be great if it did work :) ]<br>
<br>Once we have badges in place, we could add in how many "complete a task"/"get a badge."<br><br>We could also somehow leave it up to the organizer what the "health formula."<br>
<br><b>And then:<br><br></b>This was longer than I meant but hopefully this shows what I'm thinking and makes sure I'm covering everything :) Please let me know if you have any questions!<br><br>I'm looking forward to the feedback and really looking forward to coding this up! I think this will benefit many organizers.<br>
<br>By the way, the chart maker is <a href="http://www.highcharts.com" target="_blank">http://www.highcharts.com</a>. It's free for non-profits and I think it fits in with our license. If not, I'll need to look for something else.<br>
<br>Thank you!<br>Jessica<br><font color="#888888"><br>-- <br><font color="#999999" face="georgia, serif" size="1">Jessica Ledbetter</font><div><a href="http://jessicaledbetter.com" target="_blank"><font color="#999999" face="georgia, serif" size="1">http://jessicaledbetter.com</font></a></div>
<div><br></div><br>
</font><br>_______________________________________________<br>
p2pu-dev mailing list<br>
<a href="mailto:p2pu-dev@lists.p2pu.org">p2pu-dev@lists.p2pu.org</a><br>
<a href="http://lists.p2pu.org/mailman/listinfo/p2pu-dev" target="_blank">http://lists.p2pu.org/mailman/listinfo/p2pu-dev</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br><a href="http://reganmian.net/blog">http://reganmian.net/blog</a> -- Random Stuff that Matters<br><br>
</div>