A/B test 'Comics' slice on Stories landing page

[jennpb]

What is it and who's it for?

We currently have storiesLandingComics behind a toggle. This treatment shows 3 series cards as a way to surface more and older comics.

An alternative/B option is to show the latest 3 published comics (individual), rather than the series itself.

When rolling out the comics slice, we should A/B test this so we understand whether series or article cards drive an increase in readers, and an increase in page views.

Dependencies

• Waiting for Editorial to provide suitable copy for the series-level promo cards (https://github.com/wellcomecollection/wellcomecollection.org/issues/8399#issuecomment-1369699105)

Measurement

• More people reading comics: increase in users
• More comics being read: increase page views on comics

Background

https://wellcome.slack.com/archives/CUA669WHH/p1671121597285889

Done when

• [x] Decide with Danny what option to take forward
• [ ] Agree success measure for test

[jennpb]

Discussion on 15/2/22: Showing the latest 3 published comics is more complicated because we don't tend to run 3 concurrent series. This means that one series would show the latest comic, but potentially the other two series would be frozen in time, showing their final comic.

This could potentially be improved once Prismic data is in Elasticsearch.

We'll hold off on any A/B testing until then, and release version A from behind the toggle.

[jennpb]

A version Series 1 > Series 1 landing > Comic Series 2 > Series 2 landing > Comic Series 3 > Series 3 landing > Comic

B version Most recent comic from Series 1 > Comic Most recent comic from Series 2 > Comic Most recent comic from Series 3 > Comic

Questions:

• How many series are run concurrently?
• If it’s only one series at a time, Series 2 and Series 3 would display latest comics until a new series starts and bumps Series 3 off the grid. This doesn't seem useful at all, the list would be largely static because Series 2 and Series 3 would not change regularly.

C version First comic from Series 1 > Comic First comic from Series 2 > Comic First comic from Series 3 > Comic

D version 3 most recent comics > Comic Questions:

If only one series is run at a time, this will show 3 comics from the same series?

PROBLEMS/OPPORTUNITIES

• Users aren't notified when something is ❇ NEW ❇
• New content potentially getting buried
• Balance between exploring the comics archive/depth of series + seeing the newest
• Last comic in series has a sense of finality - odd to start at the end

QUESTIONS:

• New comic in hero position?

[jennpb]

Agreed with @davidpmccormick that we'd launch the C version this week

[jennpb]

Key info moved to a new testing brief we're going to trial https://docs.google.com/document/d/12cfGcjh8tqKVCBgdI-ifJtijxAVJNoXhiLvZH3_VQLI/edit?usp=sharing