mozilla-services / services-engineering

Services engineering core repo - Used for issues/docs/etc that don't obviously belong in another repo.
2 stars 1 forks source link

Future of Sync blog post #27

Closed jrconlin closed 3 years ago

jrconlin commented 4 years ago

We've been running fairly silent about what our plans for sync are (We've discussed it internally a lot, but not with the wider public, and that's bad). This leads to things like this, but more often leads to FUD.

We need to put together a lengthier post highlighting what our plans are, how it will impact folk, and some of the reasons we picked what we did.

jrconlin commented 4 years ago

Rough draft (sorry, internal only for now) https://docs.google.com/document/d/1DjwT-Atcm1qVJVL3_r8V9-BaWupCj2M2xItfFudZ4Qw/edit?usp=sharing

quinndiggity commented 4 years ago

Hi there! Looking forward to reading the post.

As a refugee of the absolute nightmare that the chromium ecosystem has become, I've fallen in love with Firefox again (have definite nostalgia of moving from IE6->Firefox 1.0.3), and believe it to be the only reasonable choice in current times.

The quality of the support behind self hosting a syncserver for Firefox is unparalleled (https://github.com/brave/sync/issues/58).

Glad to see Mozilla moving to rust for this component, but it would be great if there were an update on the progress as it's difficult to determine the production-readiness from the https://github.com/mozilla-services/syncstorage-rs repo currently.

jrconlin commented 4 years ago

Well, for what it's worth, we're running syncstorage-rs in production and have already begun migrating folks onto it. We've hit a few odd snags as we work out kinks and unexpected bugs and issues. We've now able to pay a bit more attention toward the self hosting side.

Not to make excuses, but we're a tiny team and have three services we're responsible for, so we can't dedicate time to this as much as we'd want to. Thus some of the slow progress. Still we've got issues out for work that we think needs to be done. Not to say that's all of the bugs that are blocking things, but those are the most evident.

fabianwenk commented 3 years ago

Is there any new information available regarding the migration for custom sync server to syncstorage-rs?

I am asking, as with my "old" installation I run into this issue with Firefox 80. As I see it, the README for syncstorage-rs is somehow irritating, as in the "Connecting to Firefox" section it still points to documentation of the "old" syncserver. I would like to get rid of Python 2.7.

I personally would also be fine with a complete new installation, as the number of users / browsers using it is quite small.

jrconlin commented 3 years ago

Not really, the blog post is more about why we rebuilt it and the benefits (data doesn't randomly disappear because a node dropped, etc.)

We're still working on the stand-alone side of syncstorage-rs. If you're willing to use a potentially not quite ready product, we'd love to get some help or at least a bit of debugging.

As for pointing the latest firefox for android at a different server, we got the details from the folks that wrote that part.

Go to the menu (the shishkebab menu in the lower right corner, ff1

At that point, you need to be logged out of Sync. You'll see two additional menu options: "Custom Firefox Account server" and "Custom Sync server" ff3

This should let you specify the auth and sync server, (or just the sync server). You won't be able to use the quick sign-in, so pick "Use email instead" ff4

I have no idea if this is available on iOS (sorry, I just work on the back end stuff).

If you're willing to help out work on the stand-alone sync server and don't mind working in Rust, you can help us get things going over at https://github.com/mozilla-services/syncstorage-rs. Or you can try running the existing server inside of a Docker image because of the OpenSSL issues around 1.1.1g.

quinndiggity commented 3 years ago

@jrconlin thank you so much for the info on the custom sync server uri setting location; my experience on post version 68 was completely broken without this - why was this buried in a debug menu :confounded:

jrconlin commented 3 years ago

Unfortunately, I can't answer that one (no, really. I'm not part of the team that makes the decisions on mobile clients). I'm going to guess that the thought was that this is a specialty feature and that in order to keep things simple for most users, the option was moved to the debug menu. It's my hope that the team is working with Sumo (the mozilla support group) to make sure that the steps are clearly stated.

All that stated, I absolutely appreciate that the latest version of firefox for android is a complete re-write, from a small team. Their focus was getting a version out that worked and didn't have all the problems of the older version. They had to carefully pick and choose what to focus on first. Honestly, they performed miracles, so part of the decision to bury the self-hosting may be due to things not being 100% ready. In short: There may be dragons, and if you find any, PLEASE FILE BUGS!

quinndiggity commented 3 years ago

For sure; completely understood - it was rhetorical, but I certainly didn't make that clear.

To be frank, I'm concerned about the future of the web, which is the source of my complaints. Firefox is the last line of defence nowadays, between Google having gone their standard route of "do a great job, capture a large market, then be evil; also let it fall apart once shipped and handed over to operations", HTTP/2.0 (and even more so, 3.0) and the web stack in general being far less approachable to new engineers than it was when I started out in 1997, Facebook (the company who claimed it was impossible to achieve 60fps in html5, demonstrating their lack of capability with the tools, then made a library which became prevalent :roll_eyes: ) in general, and Apple doing everything they can to hold back the web and railroad developers into their Walled Dumpster Fire (which still doesn't support WebRTC in WKWebView the last time I checked, for example), and most recently the problems from Chrome which crept into Chromium are now filtering downstream into all the derivatives like Brave, etc... the web is at serious risk if Mozilla fails to honour guard it and makes large slip ups that kill off its userbase :cry:

jrconlin commented 3 years ago

posted

chr15m commented 3 years ago

@jrconlin where is it posted? Would love to read & share.

jrconlin commented 3 years ago

Heh, on the oft unread Mozilla Services blog