Automattic / wp-calypso

The JavaScript and API powered WordPress.com
https://developer.wordpress.com
GNU General Public License v2.0
12.4k stars 1.98k forks source link

[Bug] Subscriptions: Blog followers have to "re-subscribe" after losing their follower status by no apparent reason #51787

Closed davipontesblog closed 1 year ago

davipontesblog commented 3 years ago

A user reached out to WP.com support to report that over the course of the last 2 weeks they have followers (blog followers) reporting they aren't receiving email notifications for new blog posts anymore, thus losing their "follower status" on the site, which the site owner can verify in calypso. The site owner is also receiving email notifications from WP.com that their long-time followers are "now following their site", indicating the users are triggering a new "Follow" subscription:

Screen Shot 2021-04-08 at 12 15 36

This is concerning since the user has many loyal followers who subscribe via email and the site owner has no way of knowing who (if anyone) has been impacted by this, and thus would not be receiving emails anymore until they subscribe again.

@simison mentioned this may have been related to a recent 3rd party cookie mitigation change, and @josephscott stated that the list of followers is in the backend database, so we wouldn’t expect third-party cookies to be at play here.

Full discussion with more specific/detailed user information here: p1617715563025600-slack-CS108SDLZ

This is on an atomic site.

Steps to reproduce the behavior

I don't have steps to replicate, and I don't have a way to measure impact here.

benchilcote commented 3 years ago

User shared an update on another specific user who is repeatedly being disconnected as a follower.

3885262-zen

kriskarkoski commented 3 years ago

There have been a couple reports of users unfollowing and refollowing shortly after that may be related to the same underlying issue:

davipontesblog commented 3 years ago

The user has a follower that commented to them the following:

And you don’t even show up in my Reader.

I checked the Reader and I can see the site come up; the Reader feed also returns what you would expect and I can't see any errors or red flags there so, likely, just what they described that they lost the Follower status and had to resubscribe.

chrisfromthelc commented 3 years ago

3905119-zen seems to be another occurrence of this. The site being targeted is a simple site (Premium).

ClassicRKR27 commented 3 years ago

3929902-zen appears to have this issue as well.

bsanevans commented 3 years ago

Just noting 3885262-zd-woothemes will need a response from us, once this issue has been resolved.

2021-05-26: user checked-in again, 4014851-zd-woothemes

daria2303 commented 3 years ago

3905119-zd-woothemes

kosiew commented 3 years ago

3957016-zen

The ticket contains several followers who lost the site and had to refollow several times.

Customer requested to be updated when this issue resolves.

carinapilar commented 3 years ago

User came back on 29394594-hc for an update, and mentioned:

And this problem is happening to others, we discussed with other bloggers having the problem

Their account's RC shows lots of subscribed/unsubscribed actions.

davipontesblog commented 3 years ago

@4thhubbard this one needs to be investigated more to truly understand the volume of impact in Dotcom. Could you assign it to a Pod to prioritize? I already checked with @kristenzuck and there is not a ton we can see from the data we have, but I believe it may be affecting a lot more users, and they are just not reporting it.

simison commented 3 years ago

I brought it up at flow-patrol pod yesterday as well. 👍 cc @yansern @porada @taggon

A good example of an unowned issue; I'll mark it with high priority for now for visibility, as it can indeed be quite widely spread depending on what's the bug/cause. Feel free to lower priority if it seems a more obscure case.

bsanevans commented 3 years ago

I've closed the ticket in our queue until we have more information we can share with the user. 3921279-zd-woothemes

Please ping me (or any other HE) if/when we have more information to share, so we can start a new ticket.

daria2303 commented 3 years ago

Another one, Premium: 28444483-hc 3978411-zd-woothemes

gwensmithx commented 3 years ago

3957016-zen

The ticket contains several followers who lost the site and had to refollow several times.

Customer requested to be updated when this issue resolves.

Just a note that I've closed the ticket for now since it's been floating in the queue for awhile but I gave the customer the ticket number so they can reference that for an update at any point.

kristarella commented 3 years ago

Closing 3905119-zen

Please open new ticket when fixed

daria2303 commented 3 years ago

Here user mentioned "I tried to subscribe again by email, but I get an error message." 3994982-zd-woothemes

yansern commented 3 years ago

Hi all, I was looking into this issue for a while but it is a bit of a rabbit hole but here's some technical analysis:

The first anomaly is that even when a user subscribes to a blog for the first time, a blog_unsubscribe event is created, followed by a blog_subscribe event. Upon further digging, this strange unsubscribe event is handled by subscriptions_remove_matrix_subscriber.

What I don't understand is the difference between subscriptions_remove_subscriber and subscriptions_remove_matrix_subscriber, and why one is used over the other depending on where you're subscribing / unsubscribing. In terms of UI entrypoints where you can subscribe or unsubscribe, you can do so via:

In terms of where to look in code, the SubscriptionManagement and Blog_Subscription class is where to start. If you're drilling in reverse (meaning tracing from who calls the audit event back to the function that does it), you may end up with codes that are not in use, e.g. the XMLRPC calls in Jetpack that handles subscription which is no longer used.

Also, there seems to be a delay between the time when the subscribe/unsubscribe action is made to the time the audit log shows up, and sometimes, the order of the event seems to be reversed, meaning, subscribe audit event shows up, then unsubscribe audit event shows up. This latency and random order maybe has something to do with queueing & firing of audit events (I'm not sure if there's such a thing but I imagine there should be if there's a lot of logging to be done). This sort of led to questioning whether or not the audit log itself is trustworthy, meaning just because the last audit event was unsubscribe, doesn't mean the user has unsubscribed from the blog post.

Unfortunately as this is taking too much time and leading nowhere promising I have to drop this for now. Hopefully this helps for the next person who picks this up! :)

mikeicode commented 3 years ago

Customer is 28733597-hc ran into this. User RC shows sites being unfollowed, they say it has been happening multiple times recently.

devNigel commented 3 years ago

Any update on this? 3929902-zc came back for an update on this issue.

They would like to be notified once it is fixed.

DavidSaladu commented 3 years ago

4037950-zen also notified us that the issue is still appearing and reminded us of the issue.

They would like to be notified once it is fixed as well.

DanAntion commented 3 years ago

I brought this issue to the attention of Support back in March. If it's any help, I'd like to share a few of the things that are happening:

Since March, I have emailed and replied to emails with the support engineers over 10 times.

I have sent numerous UserIDs, email addresses, account URLs and copies of comments like the one above.

I have lost followers.

If there is anything I can do to help in the investigation of this maddening error, please feel free to contact me.

Dan

kriskarkoski commented 3 years ago

4080362-zen

The re-occurring issue of me unfollowing myself continues. It just happened today while I was away on a walk. I did not accidently click anything to unfollow myself. I simply spontaneously unfollowed myself. I'd really appreciate if this could get sorted out as it has been going on for some time now with no resolution.

As of June 19, 2021 at 8am eastern standard time I was following myself. I came back from a walk around 11am and when I clicked on the stats tag it showed I had 386 followers and when I drilled down on that, I was missing.

ahmadbaig1 commented 3 years ago

4083667-zen

Another user report.

formosattic commented 3 years ago

4080362-zd-woothemes, issue keeps happening, twice in the same day.

DanAntion commented 3 years ago

Two days ago, I was informed that WP is closing the ticket because it’s been open for too long. They say the issue is still being worked on, although the only activity I see is evidence that the issue is happening to more and more people. Ten minutes ago, while I was responding to comments on my own blog, I stopped following myself. I had responded to three or four comments. When I tried to respond to the next comment, I was asked to login and offered the opportunity to “follow this blog.” 17348AC7-45CB-4A4A-8868-455EF8BDEE81

The fact that my ticket has been open for so long that WP is closing it is truly discouraging. The fact that the problem is still affecting my followers (and now me), is making me beyond frustrated.

mrfoxtalbot commented 3 years ago

Thank you for your comment @DanAntion.

Two days ago, I was informed that WP is closing the ticket because it’s been open for too long.

I believe this message would refer to the email thread with support (ticket), which is not the same as the main issue (tracked here GitHub). I understand this distinction might not be 100% clear. I must apologize for the delay. I want to let you know that we are prioritizing this issue.

@kwight, I see this issue labeled as [Pri-High] but I do not see any progress recently. Are there any blockers? I have brought it to the attention of the Flow Patrol as it was, in fact, already on their board (cc @taggon & @yansern). Thank you!

mrfoxtalbot commented 3 years ago

Another report in 4108249-zen.

DanAntion commented 3 years ago

Thank you for your comment @DanAntion.

Two days ago, I was informed that WP is closing the ticket because it’s been open for too long.

I believe this message would refer to the email thread with support (ticket), which is not the same as the main issue (tracked here GitHub). I understand this distinction might not be 100% clear. I must apologize for the delay. I want to let you know that we are prioritizing this issue.

@kwight, I see this issue labeled as [Pri-High] but I do not see any progress recently. Are there any blockers? I have brought it to the attention of the Flow Patrol as it was, in fact, already on their board (cc @taggon & @yansern). Thank you!

--

Thank you for clarifying. The email I received mentioned that it wasn't being closed here, but it wasn't clear whether or not the focus would remain. I appreciate your effort, and I hope you can find a solution.

kwight commented 3 years ago

I see this issue labeled as [Pri-High] but I do not see any progress recently.

Correct, it's currently in the Flow Patrol domain. 👍

aleone89 commented 3 years ago

Another report: hc-30471738

MaxPhilip commented 3 years ago

Another report here: 4164374-ZD

kwight commented 3 years ago

There will be a pod dedicated to subscriptions over the coming months; this should get included there, so we should see some movement soon hopefully.

kriskarkoski commented 3 years ago

4180642-zd-woothemes

kwight commented 3 years ago

There is now a subscriptions pod that will include this in upcoming work: pbAPfg-1D1-p2

andres-blanco commented 3 years ago

I added some more logging since this issue cannot be easily reproduced. Please, keep the reports coming to this issue so we can inspect the new logs.

D65365-code

DanAntion commented 3 years ago

Thank you.

I am going to ask my readers to let me know. I have to say, most have given up, but I take this as encouraging news.

Dan

Daniel Antion @.***

On Wed, Aug 11, 2021 at 8:01 AM Andrés Blanco @.***> wrote:

I added some more logging since this issue cannot be easily reproduced. Please, keep the reports coming to this issue so we can inspect the new logs.

D65365-code

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Automattic/wp-calypso/issues/51787#issuecomment-896766457, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALZ4SETEUXVJL3O5GAC4WYLT4JRBTANCNFSM42TG4IQA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

DanAntion commented 3 years ago

I added a request to readers on my blog post today - https://nofacilities.com/2021/08/12/to-the-north-shore/

As of 1:30 pm on 8/12/21, here are the relevant comments:

https://manjameximexcessive6.wordpress.com/

"Indeed – no notification about your TD post in my mail either today, which is what I rely on lately. I thought today’s Thursday Doors were cancelled! I don’t go to Reader much any more but now I’ve checked and your post is not there either. I hope the engineers can help."

http://mcwilson1956.wordpress.com/

"Notifications of your blog posts come to me via Reader"

http://pacificparatrooper.wordpress.com/

"Tell the happiness Engineers that I use the Reader page to make certain I go to all those that I follow, but certain ones, such as yours, I purposely look for!"

http://butterflysand.wordpress.com/

"Dan you know the issues I’ve been having with your Happiness Engineers. ( I use a different moniker . . .) I can’t even find you on Reader now! So I have, again, hit all the follow buttons on your website. But I try to come looking for you every day just in case they… Screwup… Again."

http://gravatar.com/gmplano

"Sometimes I get notifications from the blogs I follow and other times I don’t. I’ve never figured it out. "

http://www.katytrailcreations.com/

"I am ‘following’ again and nope, never get notifications for any of my Thursday Doors peeps exept Marian.I feel like a gif could be inserted here but I will restrain myself. Such a mystery and I hope they solve it."

Note: Marian uses "follow-it" a third party app for people to follow. Her comment is below.

http://marianallen.com/

"No notifications. I’ll get them for a few days, then nada."

http://loisajay1213.wordpress.com/

"There you are–in my Inbox! I probably just jinxed (Hi Jinx!) it, but so far so good. If you are not showing up in my Inbox, I check to see if I am following you. More than likely not, so we go back to square one and follow."

Dan

Daniel Antion @.***

On Wed, Aug 11, 2021 at 8:01 AM Andrés Blanco @.***> wrote:

I added some more logging since this issue cannot be easily reproduced. Please, keep the reports coming to this issue so we can inspect the new logs.

D65365-code

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Automattic/wp-calypso/issues/51787#issuecomment-896766457, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALZ4SETEUXVJL3O5GAC4WYLT4JRBTANCNFSM42TG4IQA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

mreishus commented 3 years ago

It sounds like there are two separate phenomenon happening:

For (2), note that any blog admin with the remove_users capability can "delete followers", or force followers to unfollow their blog. From the follower's perspective, it would look like they randomly unfollowed. I'll note that this is probably not what's happening - in at least one of the cases I checked, the blog owner reported the problem of losing followers and had no other admin users on the blog, so it's very unlikely he was deleting followers.

Slack thread of others running into the issue here: p1629361456451400-slack-C025Q5RK2

I spent some time looking into this, and made no real breakthroughs, but left some internal notes here: 29fdb-pb

DanAntion commented 3 years ago

I also have no other admin users on my blog. In fact, I have no other users at all.

I would also like to point out, in case you aren't aware of previous emails, that some of these users have resubscribed numerous times, only to repeatedly be dropped.

Thank you for your work and the update. I do appreciate that.

Dan

Daniel Antion @.***

On Fri, Aug 13, 2021 at 2:31 PM Matthew Reishus @.***> wrote:

It sounds like there are two separate phenomenon happening:

  • (1) Users are still following the blogs but are no longer receiving notifications
  • (2) Users are unfollowing blogs they don't intend to

For (2), note that any blog admin with the remove_users capability can "delete followers", or force followers to unfollow their blog. From the follower's perspective, it would look like they randomly unfollowed. I'll note that this is probably not what's happening - in at least one of the cases I checked, the blog owner reported the problem of losing followers and had no other admin users on the blog, so it's very unlikely he was deleting followers.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Automattic/wp-calypso/issues/51787#issuecomment-898646536, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALZ4SETF27VFP32PVSNZ2CLT4VQIRANCNFSM42TG4IQA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

DanAntion commented 3 years ago

Here's one more responding to my request for input:

P.S.I’m not getting notifications of your posts."

That's from https://marianallen.com/ and I happen to know she has followed my blog many times. I doubt very much that she is accidentally unfollowing my bog.

Dan

Daniel Antion @.***

On Fri, Aug 13, 2021 at 2:31 PM Matthew Reishus @.***> wrote:

It sounds like there are two separate phenomenon happening:

  • (1) Users are still following the blogs but are no longer receiving notifications
  • (2) Users are unfollowing blogs they don't intend to

For (2), note that any blog admin with the remove_users capability can "delete followers", or force followers to unfollow their blog. From the follower's perspective, it would look like they randomly unfollowed. I'll note that this is probably not what's happening - in at least one of the cases I checked, the blog owner reported the problem of losing followers and had no other admin users on the blog, so it's very unlikely he was deleting followers.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Automattic/wp-calypso/issues/51787#issuecomment-898646536, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALZ4SETF27VFP32PVSNZ2CLT4VQIRANCNFSM42TG4IQA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

DanAntion commented 3 years ago

Here's two more comments from today's post - https://nofacilities.com/2021/08/16/hot-muggy-buggy (if you read the comments, you might be able to gauge the sentiment of your users).

http://marianallen.com/

" I didn’t get a notice for the Saturday post, but I got one for today, so … yay? 'At least they’ve mastered irony.i If that ain’t a Wednesday one-liner, I don’t know what is. LOL"

http://port4u.net/

" I wondered why I was no longer getting notices for Thursday doors. I will try unfollow then follow."

Dan

Daniel Antion @.***

On Fri, Aug 13, 2021 at 2:31 PM Matthew Reishus @.***> wrote:

It sounds like there are two separate phenomenon happening:

  • (1) Users are still following the blogs but are no longer receiving notifications
  • (2) Users are unfollowing blogs they don't intend to

For (2), note that any blog admin with the remove_users capability can "delete followers", or force followers to unfollow their blog. From the follower's perspective, it would look like they randomly unfollowed. I'll note that this is probably not what's happening - in at least one of the cases I checked, the blog owner reported the problem of losing followers and had no other admin users on the blog, so it's very unlikely he was deleting followers.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Automattic/wp-calypso/issues/51787#issuecomment-898646536, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALZ4SETF27VFP32PVSNZ2CLT4VQIRANCNFSM42TG4IQA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

DanAntion commented 3 years ago

I think you should read this post - at least the beginning. This is a woman who has followed me for a long time. She is an avid supporter and participant in a blog challenge I manage. As you will read, she was dropped from following me and several other blogs.

https://manjameximexcessive6.wordpress.com/2021/08/19/thursday-doors-19-8-21-betnava-maribor/

I'm not sure you understand or appreciate the impact of this problem. People follow a lot of blogs. When they don't get a notification, they don't usually go hunting for the reason - they have too many posts to read as it is. This problem is hurting people like me who have worked very hard to build an audience! We write, we post, WE PAY YOU, and we expect things to work. In case you haven't noticed THEY ARE NOT WORKING!

kwight commented 3 years ago

We actively working on it @DanAntion , our apologies for the frustration!

andres-blanco commented 3 years ago

Most of the users experiencing the issue seems to come through an endpoint that I've only managed to hit by using the Follow widget: image. The endpoint is: https://public-api.wordpress.com/rest/v1/sites/YOUR_SITE/follows/[new|delete]

I will keep investigating to see if we can find a solid enough pattern to make a fix.

DanAntion commented 3 years ago

That would make sense, as I think that's the follow widget that initiates a link with the Reader. Many of these users complain that they can't find my posts in the Reader.

People have been trying to unfollow my blog and re-follow it. That seems to work, initially, but then they get dropped again. Some have never lost contact. Some have been dropped more than a couple dozen times since this started.

Thanks. Dan

Daniel Antion @.***

On Thu, Aug 19, 2021 at 3:35 PM Andrés Blanco @.***> wrote:

Most of the users experiencing the issue seems to come through an endpoint that I've only managed to hit by using the Follow widget: [image: image] https://user-images.githubusercontent.com/375980/130132407-bef4af44-f122-4742-af79-173031c3c21e.png. The endpoint is: https://public-api.wordpress.com/rest/v1/sites/YOUR_SITE/follows/[new|delete]

I will keep investigating to see if we can find a solid enough pattern to make a fix.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Automattic/wp-calypso/issues/51787#issuecomment-902186465, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALZ4SEU6ULA4RW2YW7MNLEDT5VMJVANCNFSM42TG4IQA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

ClassicRKR27 commented 3 years ago

It seems that this is another report of it, though the user wants to unsubscribe from their own blog. The audit trail shows that they keep getting resubscribed: 4227985-zd-woothemes

Sandkorner commented 3 years ago

Not sure if that is exactly the same (4240614-Zen) User is experiencing problems with subscribers subscribing and at the same time some of the subscribed ones are getting un-subscribed. Several have manually subscribed again.

andres-blanco commented 3 years ago

Based on the collected logs I drafted a potential fix for this issue that is now deployed. I will keep an eye on the logs to see if it mitigates the issue.

D65844-code pdgv5Y-aG-p2

DanAntion commented 3 years ago

Thank you!

I hope it works.

Dan

Daniel Antion @.***

On Tue, Aug 24, 2021 at 8:56 AM Andrés Blanco @.***> wrote:

Based on the collected logs I drafted a potential fix for this issue that is now deployed. I will keep an eye on the logs to see if it mitigates the issue.

D65844-code pdgv5Y-aG-p2

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Automattic/wp-calypso/issues/51787#issuecomment-904615800, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALZ4SEXNEXG4FC4F2BZZ2WLT6OJHHANCNFSM42TG4IQA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&utm_campaign=notification-email .

Gustavo-Hilario commented 3 years ago

We have another report here #4269971-zen.

The user has more than 6000 followers and in this thread, some of them are complaining about this issue. The users are unfollowing the blog without taking any action.

https://behindthesceneryphoto.com

This is really strange. The other Happiness Engineers have told me it's a known bug, but they can't figure out what it is. In any event, I use a Chromebook and, less often, a Dell PC.

Liz

~~

https://jacqbiggar.com/

Hi Miriam,

Yes, I've lost many followers (people who are longtime followers and friends) and then had them refollow, only to lose them again.

I use a Macbook Air, the Google browser, and have a Wordpress.com account. Hope this helps!

Jacquie Biggar

USA Today Bestselling Author

~~

https://petespringerauthor.wordpress.com/

Hi Miriam and WordPress Folks,

I use my desktop computer and laptop computer when I'm blogging. I've been following Miriam's blog for over two years and this issue just randomly popped up. I noticed that I hadn't read anything from Miriam for 2-3 weeks and just figured she was on a blogging break. I visited her site and was surprised to see that I had been unsubscribed. I didn't think too much about it, but then it happened (approximately) two more times. I also got unsubscribed to another blogger I follow, Jacquie Biggar. (Maybe 1 more, but I don't remember for sure) I wrote to Miriam at one point to tell her about this happening. It is curious that it hasn't (to my knowledge) happened with other blogs I follow. I hope you can get to the bottom of this because if I were in her shoes, I would find that particularly annoying.

Thanks,

Pete Springer