search

pressbooks / ideas

Ideas for Pressbooks.
GNU General Public License v3.0
12 stars 4 forks source link

Instrument Pressbooks to Produce Caliper Analytics 1.1 statements #123

Open ghost opened 6 years ago

ghost commented 6 years ago

@SteelWagstaff commented on Aug 18, 2017, 8:15 PM UTC:

Description

We'd like to instrument Pressbooks to enable it to produce Caliper Analytics statements that contain information about reader/learner engagement behaviors for Pressbooks titles. I've recently made a start with lsloan on this while at an IMS Global hackathon. I've spoken with hughmcguire briefly about this in the past, and we've proposed to speak about this at the Open Education conference in Anaheim in October so more will be forthcoming, but I wanted to submit this issue as a starting point for public discussion. The 1.1 specification of Caliper Analytics, primarily authored by arwhyte, is currently in a private GitHub repo (available only to IMSGlobal members), but is planned for public release shortly. We're working on a branch to demonstrate this--it's very rough but up here. Our goal is to begin by instrumenting Pressbooks to produce session profile information, and then reading metric profile information, and ultimately to produce annotation and assessment information produced with the Hypothes.is and H5P plugins we're using with Pressbooks.

This issue was moved by greatislander from pressbooks/pressbooks#888.

ghost commented 6 years ago

@SteelWagstaff commented on Aug 18, 2017, 10:42 PM UTC:

We wrote a very quick and dirty test directly in pressbooks.php, but our plan now that we've confirmed that we can in fact produce simple statements and send them to a Learning Record Store is create a separate class for the caliper sensor/emitter functions.

ghost commented 6 years ago

@lsloan commented on Aug 3, 2018, 5:07 PM UTC:

It's a shame that this issue hasn't gotten more interest. SteelWagstaff and I developed a simple instrumentation for a Caliper SessionEvent with the LoggedIn action. It can be seen in my fork of the pressbooks repo:

Admittedly, it's a simple, dirty proof-of-concept. However, I imagine that a cleaner implementation of the Caliper Reading Profile would be valuable to instructors who want to know how much time a student needs to read their materials, which pages are the most popular, and a number of other questions.

greatislander, can you explain why the issue was closed?

ghost commented 6 years ago

@connerbw commented on Aug 3, 2018, 5:11 PM UTC:

We're using Github for bug reports (and things we are working on "right now") since January.

We announced this in our opensource channels and no one had issues with it?

https://pressbooks.org/blog/2018/01/25/github-housekeeping/

Please move to ideas repo: https://github.com/pressbooks/ideas/issues?utf8=%E2%9C%93&q=is%3Aissue+is%3Aopen+analytics

SteelWagstaff commented 6 years ago

Thanks for moving this here, @greatislander. Lance, I've been really happy with Pressbooks' responsiveness on this and other issues, actually. They have a very small (but outstanding) development team, and recently announced that deeper research into analytics is on their Q3 roadmap for 2018: https://pressbooks.education/news/2018/07/q3-roadmap-forecast/, which is about all I think I can ask for without sending more funding their way. Now that the Unizin hosting deal is done and publicly announced (https://pressbooks.education/news/), maybe this is something we can revisit as a Unizin joint project?

lsloan commented 6 years ago

@SteelWagstaff I'd like to work on Caliper instrumentation of Pressbooks. However, UMich doesn't use PB in classroom settings and the people who use it here haven't shown any interest in analytics. Without a local need for it, my managers won't approve my working on it. They'll fill my time with other priority projects. 🙁

lsloan commented 6 years ago

Mention of "analytics" in Pressbooks roadmap: https://pressbooks.org/roadmap/#user-interface

SteelWagstaff commented 4 years ago

It looks like we may be returning to this in early 2020 after a long hiatus. The current Caliper 1.1 spec can be found at https://github.com/IMSGlobal/caliper-spec/blob/master/caliper-spec.md and @lsloan' s draft implementation of a PHP-based Caliper sensor can be found at https://github.com/IMSGlobal/caliper-php. The very rough start at instrumenting Pressbooks to emit Caliper statements we made in 2017 can be seen at https://github.com/lsloan/pressbooks/blob/b6ba449/pressbooks.php#L46-L89