search

mozilla-services / services-engineering

Services engineering core repo - Used for issues/docs/etc that don't obviously belong in another repo.
2 stars 1 forks source link

Prepare datasets for profiles for QA #37

Closed tublitzed closed 4 years ago

tublitzed commented 4 years ago

In prep for QA to test the migration script using profiles with varying amounts of data, we need to first:

  1. Determine what kinds of datasets we want to test against.
  2. Prep as much data as we can to send along to SV to assist with QA-ing.
tublitzed commented 4 years ago

We'll need this for SV on or before 2/14.

tublitzed commented 4 years ago

Based on the (rough) estimation of 2.5MB sync data per user, I’m going to put together 4 datasets for QA to work with for testing the migration: 7.5MB, 5MB, 2.5MB, and 1MB. Exploring possible sync engines now; bookmarks should be easy, TBD on the others. Will prioritize passwords next since that's a critical sync engine.

tublitzed commented 4 years ago

looks like bookmarks JSON (ie, example here) winds up being roughly 1.7x larger server side(BSO) than it is in the JSON format imported into client.

I'll get bookmarks together and then see how much time is left here. So, roughly:

XL - 7.5 MB BSO - 4.4MB JSON L - 5.0 MB BSO - 2.9 MB JSON M - 2.5 MB BSO - 1.4 MB JSON S - 1.0 MB BSO - 0.5 MB JSON

tublitzed commented 4 years ago

^ sizes are going to roughly approximate this for now.