jobisoft / EAS-4-TbSync

[Thunderbird Add-On] The Exchange ActiveSync provider for TbSync to sync contacts, tasks and calendars to Thunderbird.
https://github.com/jobisoft/EAS-4-TbSync/wiki/About:-Provider-for-Exchange-ActiveSync
Mozilla Public License 2.0
195 stars 29 forks source link

Microsoft sends wrong estimate, which blanks calendars (but not tasks) #274

Open llvilanova opened 3 weeks ago

llvilanova commented 3 weeks ago

Your environment

TbSync version: 4.11 EAS-4-TbSync version: 4.12 Thunderbird version: 128.1.1esr

Expected behavior

Calendar in my office365 account gets populated with all entries created in the past.

Actual behavior

Only newly created calendar entries (since upgrade to TB 128 and respective TbSync plugin updates) are shown in TB's calendar. Old entries are not retrieved even after I tell TbSync that "synchronization period" is "all".

Using the debugger to force "SyncKey" to "0" in sync.requestRemoteChanges (sync.js:404) results in Sync error code 4 from the server.

Steps to reproduce

In my case, just upgrading to TB 128 and respective TbSync plugin updates.

jobisoft commented 3 weeks ago

Are you using the Flatpack version of Thunderbird 128? Or Snap?

jobisoft commented 3 weeks ago

Since I have not changed the version for TB115 and this is reported by users of the OLD version for TB115 and the NEW version for TB128, Microsoft changed something. I fear this is out of my control.

ottomano commented 3 weeks ago

Since I have not changed the version for TB115 and this is reported by users of the OLD version for TB115 and the NEW version for TB128, Microsoft changed something. I fear this is out of my control.

Please keep us posted on this. I just reinstalled TB 128 and now I can't retrieve all my calendar entries. 😕

jobisoft commented 3 weeks ago

I do not think this is related to Thunderbird 128. Reports indicate that Thunderbird 115 is affected as well. It appears only certain Microsoft services are affected.

jobisoft commented 3 weeks ago

If you enable debug logging, you will find such an entry on all fresh synced (disabled and then re-enabled) calendars:

<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Response>
<Status>1</Status>
<Collection>
<CollectionId>14</CollectionId>
<Estimate>0</Estimate>
</Collection>
</Response>
</GetItemEstimate>

The server sends that he has no data for calendars.

Note: It does send the correct estimate for tasks and contacts.

Microsoft messed up their server.

jobisoft commented 3 weeks ago

It may be time for some background information: My EAS provider was not written for Office 365 or big Exchange Servers (EWS). It was written for true Exchange Active Sync Servers (EAS), which do not offer any other protocol to access them, but use EAS as their primary access protocol.

My users learned by trying, that Office365/Hotmail/Outlook.com also "works" with my provider, which means Microsoft supports the EAS protocol on these platforms. But EAS is not the primary protocol there, that would be EWS, OWA or Graph. Users did realize that already, because EAS does not provide the full feature set, like accessing shared calendars. After being asked, I did put some effort into supporting the Microsoft platforms, for example by implementing OAUTH support.

If Microsoft did now mess up the EAS interface to their platform, there is nothing I can do. As reported by many of you, it suddenly stopped working, and it is not (!) related to the recent update, because it also fails for users who are still on Thunderbird 115.

I can still sync calendars with the servers my EAS provider was originally written for.

damien-git commented 3 weeks ago

I am not sure what the estimate is used for in EAS-4-TbSync, but is it possible you would get data if you simply ignore it ? It is just an "estimate" after all...

jobisoft commented 3 weeks ago

That estimate reference was just a hint. I am requesting the full changes after the estimate. But that request comes back empty.

damien-git commented 3 weeks ago

I think ActiveSync can be used by Outlook clients if configured to, to access 365 calendars. There was an issue in February affecting them. So shouldn't this change affect them as well ?

jobisoft commented 3 weeks ago

If they really do use EAS, they could be affected as well. But I assume they use EWS instead. But this is all just guessing. Fact is I follow the spec and it worked for multiple years and now it no longer works for MS.

llvilanova commented 3 weeks ago

Are you using the Flatpack version of Thunderbird 128? Or Snap?

I'm using the version packaged in Debian, and I'm indeed accessing my Office365 account.

wiraki commented 2 weeks ago

I do not think this is related to Thunderbird 128. Reports indicate that Thunderbird 115 is affected as well. It appears only certain Microsoft services are affected.

Can confirm on 115 .deb version as well.

Thanks for all the info. What a bummer :( Any suggestions where to look for updates/fixes on this?

schillic commented 2 weeks ago

It just started working again for me. Hooray!

bubble75 commented 2 weeks ago

One more observation: If event arrives while Thunderbird is running with ActiveSync account is enabled - it is shown in calendar. Once I disable and reenable account or restart Thunderbird - it is no longer shown.

bubble75 commented 2 weeks ago

One more observation: If event arrives while Thunderbird is running with ActiveSync account is enabled - it is shown in calendar. Once I disable and reenable account or restart Thunderbird - it is no longer shown.

Just started to work again.

ottomano commented 2 weeks ago

Still not working for me on Office 365 calendar, but now I have big hopes after it started working for others. (fingers crossed)

schor123 commented 2 weeks ago

Can confirm it started working again. I removed all calendars, uninstalled tbsync; re-started Thunderbird, re-installed tbsync + exchange provider and there we go: all calendars/tasks are back.

scylla999 commented 2 weeks ago

I also confirm it's working again after removing calendars, uninstalling both TbSync and EAS-4-TbSync, restarting Thunderbird, re-installing the extensions and then re-adding calendars with M365 Oath2.

damien-git commented 2 weeks ago

Tried all that: removing calendars, uninstalling TbSync and EAS-4-Tbsync, restarting Thunderbird, re-installing the extensions and re-adding Office365 calendars - still nothing.

ottomano commented 2 weeks ago

Tried all that: removing calendars, uninstalling TbSync and EAS-4-Tbsync, restarting Thunderbird, re-installing the extensions and re-adding Office365 calendars - still nothing.

Same issue here, unfortunately.

faz17 commented 2 weeks ago

Tried all that: removing calendars, uninstalling TbSync and EAS-4-Tbsync, restarting Thunderbird, re-installing the extensions and re-adding Office365 calendars - still nothing.

Same here

geg-ck commented 2 weeks ago

Back to working for me. Uncheck the box next calendar in the Sync dialog, sync, re-check the box next to calendar, sync again.

LamyLab commented 2 weeks ago

Same as geg-ck.

jobisoft commented 2 weeks ago

It may be helpful to note which platform.

So instead of "same here", post something like "outlook.com: OK" or "office365: NOK"

NEP1192 commented 2 weeks ago

outlook.Office365.com, not working

TbSync v4.11 ActiveSync v4.12

geg-ck commented 2 weeks ago

Microsoft365 Exchange Online - OK here. TbSync v4.11 ActiveSync v4.12

eamathw commented 2 weeks ago

outlook.office365.com working TbSync v4.8 Provider for Exchange ActiveSync v4.8

jobisoft commented 2 weeks ago

outlook.office365.com working TbSync v4.8 Provider for Exchange ActiveSync v4.8

That is even better!

billksun commented 2 weeks ago

outlook.office.com is working here.

U2Vj commented 2 weeks ago

outlook.office365.com working TbSync v4.8 Provider for Exchange ActiveSync v4.8

presianbg commented 2 weeks ago

Still not working:

mlassnig commented 2 weeks ago

Not working:

Repeated installs/refreshs... same effect that only new events get loaded in.

ottomano commented 2 weeks ago

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.

@jobisoft I can provide you debug log via DM if needed

jobisoft commented 2 weeks ago
  • TB 128.2.0 esr / Windows 10

    • outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working.

@jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: https://github.com/jobisoft/EAS-4-TbSync/issues/274#issuecomment-2338395919

If the estimate for all your calendars is 0, your server is still not reporting any entries.

ottomano commented 2 weeks ago
  • TB 128.2.0 esr / Windows 10

    • outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working. @jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment)

If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result.

Here the XML response


<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>
jobisoft commented 2 weeks ago
  • TB 128.2.0 esr / Windows 10

    • outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working. @jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment) If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result.

Here the XML response


<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>

That is the request.

ottomano commented 2 weeks ago
  • TB 128.2.0 esr / Windows 10

    • outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working. @jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment) If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result. Here the XML response


<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>

That is the request.

Sorry, my fault.

<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Response>
<Status>1</Status>
<Collection>
<CollectionId>6</CollectionId>
<Estimate>0</Estimate>
</Collection>
</Response>
</GetItemEstimate>
jobisoft commented 2 weeks ago

Yep, your server does not report any data for you. I guess you have to keep waiting. Maybe Microsoft is rolling out the fix in waves and it does not hit all servers at the same time.

If that estimate comes back non-zero and you still do not get data, I can start looking at it again. Until then, you have to be patient. Disable and re-enable your TbSync account once a day and see if a fresh sync brings back any data and/or it reports a non-zero estimate.

bermeitinger-b commented 2 weeks ago

It started working for me. So patience is the only way to go :)

Thanks!

faz17 commented 2 weeks ago

Tbsync 4.11 Provider Activesync 4.12 thunderbird 128.2.0 esr windows 11 outlook.office365.com EU still not working. Here is the log

<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>2047807048</SyncKey>
<CollectionId>9</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>
presianbg commented 2 weeks ago

Still not working:

  • EU
  • Microsoft 365 (Exchange Online) (outlook.office365.com)
  • TB 128.2.0esr
  • TbSync v4.11
  • Provider for Exchange ActiveSync 4.12

It started working... Microsoft being Microsoft :)

ottomano commented 2 weeks ago
  • TB 128.2.0 esr / Windows 10

    • outlook.office365.com

Deleted both TBsync and EAS, rebooted PC, reinstalled both plugins. unfortunately it's not working. @jobisoft I can provide you debug log via DM if needed

You only have to disable and re-enable the TbSync account to see if entries are coming back. No need to uninstall anything. Check your debug log for the estimate entry as shown here: #274 (comment) If the estimate for all your calendars is 0, your server is still not reporting any entries.

Yes, I did it but with same result. Here the XML response


<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Collections>
<Collection>
<SyncKey xmlns='AirSync'>11187586</SyncKey>
<CollectionId>6</CollectionId>
<Options xmlns='AirSync'>
<FilterType xmlns='AirSync'>7</FilterType>
<Class xmlns='AirSync'>Calendar</Class>
</Options>
</Collection>
</Collections>
</GetItemEstimate>

That is the request.

Sorry, my fault.

<?xml version="1.0"?>
<GetItemEstimate xmlns='GetItemEstimate'>
<Response>
<Status>1</Status>
<Collection>
<CollectionId>6</CollectionId>
<Estimate>0</Estimate>
</Collection>
</Response>
</GetItemEstimate>

it started "working" again. But it does not download all entries once. Seems it is slowly downloading few entries each hour (so, now my calendar on TB is roughly at 50% of the real calendar on Outlook).

SirFritz commented 2 weeks ago

This never started working again for me. Instead now on two different computers it locks up Thunderbird when trying to sync calenders.

damien-git commented 2 weeks ago

It finally started working for me too (O365, TB128). I used a read-only ics link while I was waiting.

faz17 commented 2 weeks ago

And finally it's working again also for me!