search

bellingcat / cisticola

Coordinates scrapers and interfaces with database
17 stars 1 forks source link

Gabber scraper hangs indefinitely in certain cases #27

Open loganwilliams opened 2 years ago

loganwilliams commented 2 years ago

Test case:

38 QAnon John   qanon 39.5k Gab https://gab.com/QAnon_John   US                                  
loganwilliams commented 2 years ago

Not really a "hang" -- continuously makes GET requests without every yielding a post.


2022-04-02 13:27:12.913 | INFO     | gabber.client:_get:65 - GET: https://gab.com/auth/sign_in
2022-04-02 13:27:13.915 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/account_by_username/QAnon_John
2022-04-02 13:27:14.909 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true
2022-04-02 13:27:15.490 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=108055213903584647
2022-04-02 13:27:16.116 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=108047430892844863
2022-04-02 13:27:17.076 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=108041989210313303
2022-04-02 13:27:17.671 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=108035171974547148
2022-04-02 13:27:18.894 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=108021010814050802
2022-04-02 13:27:20.008 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=108012975969544141
2022-04-02 13:27:21.003 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=108002288810826866
2022-04-02 13:27:22.248 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107996551471341460
2022-04-02 13:27:23.349 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107987880600990144
2022-04-02 13:27:24.000 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107979197426260370
2022-04-02 13:27:24.978 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107968270979426623
2022-04-02 13:27:25.957 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107962951532921282
2022-04-02 13:27:26.963 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107956994237812374
2022-04-02 13:27:27.689 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107945836028559824
2022-04-02 13:27:28.855 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107935881504223694
2022-04-02 13:27:29.987 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107934284494035041
2022-04-02 13:27:31.183 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107924257127986130
2022-04-02 13:27:32.387 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107912726118041033
2022-04-02 13:27:33.334 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107896354134531221
2022-04-02 13:27:34.297 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107884737129679875
2022-04-02 13:27:34.929 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107883116758116970
2022-04-02 13:27:35.579 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107876762784914445
2022-04-02 13:27:36.512 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107853723110899063
2022-04-02 13:27:37.155 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107844065352975884
2022-04-02 13:27:37.839 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107834337203318648
2022-04-02 13:27:38.485 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107815794588530169
2022-04-02 13:27:39.097 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107798035160833654
2022-04-02 13:27:40.075 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107776876869808084
2022-04-02 13:27:41.174 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107759455051350962
2022-04-02 13:27:42.051 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107737829851369295
2022-04-02 13:27:43.322 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107720188835710190
2022-04-02 13:27:44.004 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107707546779559014
2022-04-02 13:27:44.689 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107690422350780398
2022-04-02 13:27:45.681 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107684456735450471
2022-04-02 13:27:46.682 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107662103449548712
2022-04-02 13:27:47.730 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107650092143315255
2022-04-02 13:27:48.745 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107633410892035169
2022-04-02 13:27:49.463 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107621781887351370
2022-04-02 13:27:50.199 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107611139859320760
2022-04-02 13:27:50.873 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107576840755129003
2022-04-02 13:27:51.876 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107537848805453868
2022-04-02 13:27:52.516 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107527348121553662
2022-04-02 13:27:53.203 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107503806737158865
2022-04-02 13:27:53.989 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107492421092932571
2022-04-02 13:27:54.994 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107460374128011839
2022-04-02 13:27:56.022 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107433538107420187
2022-04-02 13:27:56.820 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107413347280661021
2022-04-02 13:27:57.467 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107381373139381804
2022-04-02 13:27:58.277 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107359041335277297
2022-04-02 13:27:59.416 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107328520346395491
2022-04-02 13:28:00.484 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107305366263259932
2022-04-02 13:28:01.540 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107282807844814725
2022-04-02 13:28:02.195 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107255054326549764
2022-04-02 13:28:02.920 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107233247236309097
2022-04-02 13:28:03.604 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107212164370720542
2022-04-02 13:28:04.685 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107194177545546521
2022-04-02 13:28:05.700 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107121778681554150
2022-04-02 13:28:06.714 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107078509906314396
2022-04-02 13:28:07.382 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107047549023263761
2022-04-02 13:28:08.427 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107039631587843200
2022-04-02 13:28:09.654 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=107016596871952189
2022-04-02 13:28:10.764 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106989753592749803
2022-04-02 13:28:11.790 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106982984854747824
2022-04-02 13:28:12.567 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106970977699170307
2022-04-02 13:28:13.538 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106943223994487122
2022-04-02 13:28:14.176 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106903524630354558
2022-04-02 13:28:14.930 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106847716177379677
2022-04-02 13:28:15.967 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106807747246379099
2022-04-02 13:28:16.656 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106797132984234564
2022-04-02 13:28:17.298 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106780902133354256
2022-04-02 13:28:18.057 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106735361244525316
2022-04-02 13:28:18.986 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106716469420700896
2022-04-02 13:28:19.973 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106672569442558286
2022-04-02 13:28:20.950 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106649113874417801
2022-04-02 13:28:21.948 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106626240029246265
2022-04-02 13:28:22.661 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106592120762654282
2022-04-02 13:28:23.984 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106580546053347805
2022-04-02 13:28:25.092 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106564196630592160
2022-04-02 13:28:25.739 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106540455267065311
2022-04-02 13:28:26.742 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106519985649580074
2022-04-02 13:28:27.713 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106508269913960965
2022-04-02 13:28:28.336 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106480152053207924
2022-04-02 13:28:29.227 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106457364893354182
2022-04-02 13:28:30.257 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106450656921987155
2022-04-02 13:28:30.835 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106435119073078076
2022-04-02 13:28:31.519 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106423401717720729
2022-04-02 13:28:32.471 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106406999467246054
2022-04-02 13:28:33.355 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106393851381061167
2022-04-02 13:28:34.453 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106376614771107701
2022-04-02 13:28:35.445 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106361164737581122
2022-04-02 13:28:36.131 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106360230552654989
2022-04-02 13:28:37.308 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106309862247545235
2022-04-02 13:28:38.436 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106274233469100308
2022-04-02 13:28:39.571 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106231466805938675
2022-04-02 13:28:40.819 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106207256080193378
2022-04-02 13:28:41.446 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106173768509513082
2022-04-02 13:28:42.499 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106129479514162673
2022-04-02 13:28:43.474 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106098914260948843
2022-04-02 13:28:44.455 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106071791772258317
2022-04-02 13:28:45.585 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=106020286498175355
2022-04-02 13:28:46.737 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105993352685416672
2022-04-02 13:28:47.773 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105979997821176263
2022-04-02 13:28:48.481 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105963147255722594
2022-04-02 13:28:49.706 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105951778077258117
2022-04-02 13:28:50.870 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105923516253281118
2022-04-02 13:28:51.923 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105902623419887091
2022-04-02 13:28:52.586 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105885636862816437
2022-04-02 13:28:53.605 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105872227686261684
2022-04-02 13:28:54.934 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105861495116727208
2022-04-02 13:28:55.774 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105839251579162271
2022-04-02 13:28:56.381 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105827970685505319
2022-04-02 13:28:57.436 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105811466284551503
2022-04-02 13:28:58.057 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105805094670183700
2022-04-02 13:28:59.079 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105799245869773937
2022-04-02 13:29:00.177 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105787319236376680
2022-04-02 13:29:01.178 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105775825304281247
2022-04-02 13:29:02.204 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105749395684048752
2022-04-02 13:29:02.950 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105743857249984864
2022-04-02 13:29:03.593 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105732656940870952
2022-04-02 13:29:04.604 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105725895440971208
2022-04-02 13:29:05.506 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105720200780736791
2022-04-02 13:29:06.275 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105719626512390525
2022-04-02 13:29:07.184 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105714640719345328
2022-04-02 13:29:08.150 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105703414079126131
2022-04-02 13:29:08.976 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105700322924650439
2022-04-02 13:29:09.989 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105690004999768135
2022-04-02 13:29:10.680 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105675475607113238
2022-04-02 13:29:11.646 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105658596272226151
2022-04-02 13:29:12.781 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105641341809323797
2022-04-02 13:29:13.410 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105629821809767184
2022-04-02 13:29:14.050 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105618699399348214
2022-04-02 13:29:15.058 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105607401907657403
2022-04-02 13:29:16.105 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105551669285975832
2022-04-02 13:29:16.810 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105543877750413380
2022-04-02 13:29:18.099 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105534199512026045
2022-04-02 13:29:19.229 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105522081378854573
2022-04-02 13:29:20.275 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105517713549342875
2022-04-02 13:29:21.173 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105512681098081215
2022-04-02 13:29:22.671 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105499563602788291
2022-04-02 13:29:23.671 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105489436044371201
2022-04-02 13:29:24.783 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105483403613724239
2022-04-02 13:29:25.703 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105478699914854267
2022-04-02 13:29:26.664 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105471998739594912
2022-04-02 13:29:27.305 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105466128625005909
2022-04-02 13:29:28.358 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105461855425054188
2022-04-02 13:29:29.116 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105459087998387796
2022-04-02 13:29:30.180 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105443667406804538
2022-04-02 13:29:31.434 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105431046162689132
2022-04-02 13:29:32.033 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105425121169434200
2022-04-02 13:29:32.947 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105409543344976173
2022-04-02 13:29:33.674 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105403461911813315
2022-04-02 13:29:34.672 | INFO     | gabber.client:_get:65 - GET: https://gab.com/api/v1/accounts/1461829/statuses?exclude_replies=true&max_id=105398509618693364```
trislee commented 2 years ago

Could not reproduce: the posts were correctly yielded and added to the database. Was this with archive_media enabled?

Gabber uses its own rate-limited function (gabber.client.Client._get) to make and retry GET requests, this issue could suggest the need to make changes to that function.