search

mozilla-rally / search-engine-usage-study

Mozilla Public License 2.0
1 stars 3 forks source link

test out citp search study analysis environment #93

Closed betling closed 2 years ago

betling commented 2 years ago

the environment is there and I can create a notebook but don't see any data -- even demographics and enrollment. need to check with engineering to see if something else needs to be done to get this data ported over or if we just wait for app to get approved.

betling commented 2 years ago

I don't seem to be able to assign this issue to myself

knowtheory commented 2 years ago

The data platform / telemetry pipeline operates independently of whatever devices/clients are sending in data.

So, if you've got a play test version of an extension it should be fully capable of sending in data assuming a few things:

Oh, lastly, we're not recording enrollment/demographics for studies that aren't launched in the Core Addon or Platform (since there's nothing for users to sign up for yet), so the only data that you'd be able to see in the analysis environment are the measurement tables.

betling commented 2 years ago

okay, so kart should be able to test it out then. my confusion for the search study and demographics tables is that it is a study you can sign up for after enrolling in rally, but I guess what you are saying here is that right now the only thing that study is doing is launching an external qualtrics survey. that makes more sense now. thanks.

rhelmer commented 2 years ago

The enrollment and demographics pings are sent by the core add-on and go to these namespaces:

In the past, we've always set up the environment before launch the study, so I'm not sure if these are hooked up correctly or not.

We've had studies also send a redundant enrollment ping to their own environment, but we decided to move away from in favor of the rally-core ones (which will continue to be the case for the rally web platform). Since the environment wasn't set up yet any pings sent directly from the extension wouldn't be processed (but as I mentioned above the rally-core environment should be the ones that matter).