search

iptv-org / epg

Utilities for downloading the EPG (Electronic Program Guide) for thousands of TV channels from hundreds of sources.
https://iptv-org.github.io/
The Unlicense
1.66k stars 156 forks source link

[sky.de] site replies 403 - Forbidden because of useragent #2387

Closed fra-wwilhelm closed 6 days ago

fra-wwilhelm commented 1 week ago

Describe your issue

Using your tool

npm run grab -- --site=sky.de

throws an error 403 - Forbidden

After adding

'User-Agent': 'curl/788.1'

to the header section in the configuration it works as expected. It looks like Sky blocks access also user-agent based.

freearhey commented 6 days ago

It works for me without any changes. So the problem is probably not in User-Agent.

npm run grab -- --site=sky.de

> grab
> npx tsx scripts/commands/epg/grab.ts --site=sky.de

starting...
config:
  output: guide.xml
  maxConnections: 1
  gzip: false
  site: sky.de
loading channels...
  found 75 channel(s)
run #1:
  [1/150] sky.de (de) - 13thStreetUniversalHD.de - Jun 22, 2024 (32 programs)
  [2/150] sky.de (de) - 13thStreetUniversalHD.de - Jun 23, 2024 (31 programs)
  [3/150] sky.de (de) - BeateUhseTVHD.de - Jun 23, 2024 (15 programs)
  [4/150] sky.de (de) - CartoonNetwork.de - Jun 23, 2024 (115 programs)
  [5/150] sky.de (de) - DiscoveryChannelHD.de - Jun 23, 2024 (30 programs)
  [6/150] sky.de (de) - DiscoveryChannelHD.de - Jun 22, 2024 (30 programs)
  [7/150] sky.de (de) - CartoonNetwork.de - Jun 22, 2024 (121 programs)
  [8/150] sky.de (de) - DAZN2HD.de - Jun 23, 2024 (32 programs)
  [9/150] sky.de (de) - Nicktoons.de - Jun 22, 2024 (67 programs)
  [10/150] sky.de (de) - DAZN2HD.de - Jun 22, 2024 (12 programs)
  [11/150] sky.de (de) - NickJr.de - Jun 23, 2024 (81 programs)
  [12/150] sky.de (de) - NickJr.de - Jun 22, 2024 (80 programs)
  [13/150] sky.de (de) - BeateUhseTVHD.de - Jun 22, 2024 (12 programs)
  [14/150] sky.de (de) - Cartoonito.de - Jun 23, 2024 (132 programs)
  [15/150] sky.de (de) - DAZN1HD.de - Jun 23, 2024 (15 programs)
  [16/150] sky.de (de) - Motorvision.de - Jun 23, 2024 (28 programs)
  [17/150] sky.de (de) - Motorvision.de - Jun 22, 2024 (40 programs)
  [18/150] sky.de (de) - DAZN1HD.de - Jun 22, 2024 (12 programs)
  [19/150] sky.de (de) - Jukebox.de - Jun 23, 2024 (10 programs)
  [20/150] sky.de (de) - Jukebox.de - Jun 22, 2024 (8 programs)
  [21/150] sky.de (de) - Cartoonito.de - Jun 22, 2024 (132 programs)
  [22/150] sky.de (de) - CrimePlusInvestigation.de - Jun 23, 2024 (32 programs)
  [23/150] sky.de (de) - HistoryHD.de - Jun 23, 2024 (28 programs)
  [24/150] sky.de (de) - HistoryHD.de - Jun 22, 2024 (29 programs)
  [25/150] sky.de (de) - CrimePlusInvestigation.de - Jun 22, 2024 (33 programs)
  [26/150] sky.de (de) - Heimatkanal.de - Jun 23, 2024 (21 programs)
  [27/150] sky.de (de) - Heimatkanal.de - Jun 22, 2024 (26 programs)
  [28/150] sky.de (de) - SkySportGolfHD.de - Jun 22, 2024 (10 programs)
  [29/150] sky.de (de) - SkySportF1HD.de - Jun 23, 2024 (29 programs)
  [30/150] sky.de (de) - SkySportF1HD.de - Jun 22, 2024 (26 programs)
  [31/150] sky.de (de) - SkySportBundesligaUHD.de - Jun 23, 2024 (0 programs)
  [32/150] sky.de (de) - SkySportBundesligaUHD.de - Jun 22, 2024 (0 programs)
  [33/150] sky.de (de) - SkySportBundesligaHD.de - Jun 23, 2024 (23 programs)
  [34/150] sky.de (de) - SkySportBundesligaHD.de - Jun 22, 2024 (21 programs)
  [35/150] sky.de (de) - SkySportBundesliga9HD.de - Jun 23, 2024 (0 programs)
  [36/150] sky.de (de) - SkySportBundesliga9HD.de - Jun 22, 2024 (0 programs)
  [37/150] sky.de (de) - SkySportBundesliga8HD.de - Jun 23, 2024 (0 programs)
  [38/150] sky.de (de) - SkySportBundesliga8HD.de - Jun 22, 2024 (0 programs)
  [39/150] sky.de (de) - SkySportBundesliga7HD.de - Jun 23, 2024 (0 programs)
  [40/150] sky.de (de) - SkySportBundesliga7HD.de - Jun 22, 2024 (0 programs)
  [41/150] sky.de (de) - SkySportBundesliga6HD.de - Jun 23, 2024 (0 programs)
  [42/150] sky.de (de) - SkySportBundesliga6HD.de - Jun 22, 2024 (0 programs)
  [43/150] sky.de (de) - SkySportBundesliga5HD.de - Jun 23, 2024 (0 programs)
  [44/150] sky.de (de) - SkySportBundesliga5HD.de - Jun 22, 2024 (0 programs)
  [45/150] sky.de (de) - SkySportBundesliga4HD.de - Jun 23, 2024 (0 programs)
  [46/150] sky.de (de) - SkySportBundesliga4HD.de - Jun 22, 2024 (0 programs)
  [47/150] sky.de (de) - SkySportBundesliga3HD.de - Jun 23, 2024 (0 programs)
  [48/150] sky.de (de) - SkySportBundesliga3HD.de - Jun 22, 2024 (0 programs)
  [49/150] sky.de (de) - SkySportBundesliga2HD.de - Jun 23, 2024 (0 programs)
  [50/150] sky.de (de) - SkySportBundesliga2HD.de - Jun 22, 2024 (0 programs)
  [51/150] sky.de (de) - SkySportBundesliga1HD.de - Jun 23, 2024 (0 programs)
  [52/150] sky.de (de) - SkySportBundesliga1HD.de - Jun 22, 2024 (0 programs)
  [53/150] sky.de (de) - SkySportBundesliga10HD.de - Jun 23, 2024 (0 programs)
  [54/150] sky.de (de) - SkySportBundesliga10HD.de - Jun 22, 2024 (0 programs)
  [55/150] sky.de (de) - SkySportAustria7HD.at - Jun 23, 2024 (0 programs)
  [56/150] sky.de (de) - SkySportAustria7HD.at - Jun 22, 2024 (0 programs)
  [57/150] sky.de (de) - SkySportAustria6HD.at - Jun 23, 2024 (0 programs)
  [58/150] sky.de (de) - SkySportAustria6HD.at - Jun 22, 2024 (0 programs)
  [59/150] sky.de (de) - SkySportAustria5HD.at - Jun 23, 2024 (0 programs)
  [60/150] sky.de (de) - SkySportAustria5HD.at - Jun 22, 2024 (0 programs)
  [61/150] sky.de (de) - SkySportAustria4HD.at - Jun 23, 2024 (0 programs)
  [62/150] sky.de (de) - SkySportAustria4HD.at - Jun 22, 2024 (0 programs)
  [63/150] sky.de (de) - SkySportAustria3HD.at - Jun 23, 2024 (2 programs)
  [64/150] sky.de (de) - SkySportAustria3HD.at - Jun 22, 2024 (0 programs)
  [65/150] sky.de (de) - SkySportAustria2HD.at - Jun 23, 2024 (13 programs)
  [66/150] sky.de (de) - SkySportAustria2HD.at - Jun 22, 2024 (11 programs)
  [67/150] sky.de (de) - SkySportAustria1HD.at - Jun 23, 2024 (19 programs)
  [68/150] sky.de (de) - SkySportAustria1HD.at - Jun 22, 2024 (21 programs)
  [69/150] sky.de (de) - SkySport9HD.de - Jun 23, 2024 (0 programs)
  [70/150] sky.de (de) - SkySport9HD.de - Jun 22, 2024 (0 programs)
  [71/150] sky.de (de) - SkySport8HD.de - Jun 23, 2024 (0 programs)
  [72/150] sky.de (de) - SkySport8HD.de - Jun 22, 2024 (0 programs)
  [73/150] sky.de (de) - SkySport7HD.de - Jun 23, 2024 (0 programs)
  [74/150] sky.de (de) - SkySport7HD.de - Jun 22, 2024 (0 programs)
  [75/150] sky.de (de) - SkySport6HD.de - Jun 23, 2024 (0 programs)
  [76/150] sky.de (de) - SkySport6HD.de - Jun 22, 2024 (0 programs)
  [77/150] sky.de (de) - SkySport5HD.de - Jun 23, 2024 (0 programs)
  [78/150] sky.de (de) - SkySport5HD.de - Jun 22, 2024 (0 programs)
  [79/150] sky.de (de) - SkySport4HD.de - Jun 23, 2024 (0 programs)
  [80/150] sky.de (de) - SkySport4HD.de - Jun 22, 2024 (0 programs)
  [81/150] sky.de (de) - SkySport3HD.de - Jun 23, 2024 (2 programs)
  [82/150] sky.de (de) - SkySport3HD.de - Jun 22, 2024 (0 programs)
  [83/150] sky.de (de) - SkySport2HD.de - Jun 23, 2024 (2 programs)
  [84/150] sky.de (de) - SkySport2HD.de - Jun 22, 2024 (2 programs)
  [85/150] sky.de (de) - SkySport1HD.de - Jun 23, 2024 (2 programs)
  [86/150] sky.de (de) - SkySport1HD.de - Jun 22, 2024 (3 programs)
  [87/150] sky.de (de) - SkySport10HD.de - Jun 23, 2024 (0 programs)
  [88/150] sky.de (de) - SkySport10HD.de - Jun 22, 2024 (0 programs)
  [89/150] sky.de (de) - SkyShowcaseHD.de - Jun 23, 2024 (38 programs)
  [90/150] sky.de (de) - SkyShowcaseHD.de - Jun 22, 2024 (49 programs)
  [91/150] sky.de (de) - SkyReplayHD.de - Jun 23, 2024 (36 programs)
  [92/150] sky.de (de) - SkyReplayHD.de - Jun 22, 2024 (33 programs)
  [93/150] sky.de (de) - SkyOneHD.de - Jun 23, 2024 (36 programs)
  [94/150] sky.de (de) - SkyOneHD.de - Jun 22, 2024 (31 programs)
  [95/150] sky.de (de) - SkyNatureHD.de - Jun 23, 2024 (32 programs)
  [96/150] sky.de (de) - SkyNatureHD.de - Jun 22, 2024 (33 programs)
  [97/150] sky.de (de) - SkyKrimiHD.de - Jun 23, 2024 (27 programs)
  [98/150] sky.de (de) - SkyKrimiHD.de - Jun 22, 2024 (22 programs)
  [99/150] sky.de (de) - SkyDocumentariesHD.de - Jun 23, 2024 (21 programs)
  [100/150] sky.de (de) - SkyDocumentariesHD.de - Jun 22, 2024 (27 programs)
  [101/150] sky.de (de) - SkyCrimeHD.de - Jun 23, 2024 (30 programs)
  [102/150] sky.de (de) - SkyCrimeHD.de - Jun 22, 2024 (31 programs)
  [103/150] sky.de (de) - SkyCinemaThrillerHD.de - Jun 23, 2024 (0 programs)
  [104/150] sky.de (de) - SkyCinemaThrillerHD.de - Jun 22, 2024 (0 programs)
  [105/150] sky.de (de) - SkyCinemaSpecialHD.de - Jun 23, 2024 (0 programs)
  [106/150] sky.de (de) - SkyCinemaSpecialHD.de - Jun 22, 2024 (0 programs)
  [107/150] sky.de (de) - SkyCinemaPremierenPlus24HD.de - Jun 23, 2024 (0 programs)
  [108/150] sky.de (de) - SkyCinemaPremierenPlus24HD.de - Jun 22, 2024 (0 programs)
  [109/150] sky.de (de) - SkyCinemaPremierenHD.de - Jun 23, 2024 (0 programs)
  [110/150] sky.de (de) - SkyCinemaPremierenHD.de - Jun 22, 2024 (0 programs)
  [111/150] sky.de (de) - SkyCinemaFunHD.de - Jun 23, 2024 (0 programs)
  [112/150] sky.de (de) - SkyCinemaFunHD.de - Jun 22, 2024 (0 programs)
  [113/150] sky.de (de) - SkyCinemaFamilyHD.de - Jun 23, 2024 (0 programs)
  [114/150] sky.de (de) - SkyCinemaFamilyHD.de - Jun 22, 2024 (0 programs)
  [115/150] sky.de (de) - SkyCinemaClassicsHD.de - Jun 23, 2024 (0 programs)
  [116/150] sky.de (de) - SkyCinemaClassicsHD.de - Jun 22, 2024 (0 programs)
  [117/150] sky.de (de) - SkyCinemaBestOfHD.de - Jun 23, 2024 (0 programs)
  [118/150] sky.de (de) - SkyCinemaBestOfHD.de - Jun 22, 2024 (0 programs)
  [119/150] sky.de (de) - SkyCinemaActionHD.de - Jun 23, 2024 (0 programs)
  [120/150] sky.de (de) - SkyCinemaActionHD.de - Jun 22, 2024 (0 programs)
  [121/150] sky.de (de) - SkyAtlanticHD.de - Jun 23, 2024 (27 programs)
  [122/150] sky.de (de) - SkyAtlanticHD.de - Jun 22, 2024 (25 programs)
  [123/150] sky.de (de) - RomanceTVHD.de - Jun 23, 2024 (20 programs)
  [124/150] sky.de (de) - RomanceTVHD.de - Jun 22, 2024 (18 programs)
  [125/150] sky.de (de) - Nicktoons.de - Jun 23, 2024 (68 programs)
  [126/150] sky.de (de) - WarnerTVFilmHD.de - Jun 22, 2024 (13 programs)
  [127/150] sky.de (de) - WarnerTVFilm.de - Jun 22, 2024 (13 programs)
  [128/150] sky.de (de) - WarnerTVComedyHD.de - Jun 23, 2024 (49 programs)
  [129/150] sky.de (de) - SYFYHD.de - Jun 23, 2024 (27 programs)
  [130/150] sky.de (de) - SYFYHD.de - Jun 22, 2024 (28 programs)
  [131/150] sky.de (de) - SkySportUHD.de - Jun 22, 2024 (22 programs)
  [132/150] sky.de (de) - SkySportTopEventHD.de - Jun 23, 2024 (18 programs)
  [133/150] sky.de (de) - SkySportTennisHD.de - Jun 22, 2024 (13 programs)
  [134/150] sky.de (de) - SkySportPremierLeagueHD.de - Jun 23, 2024 (44 programs)
  [135/150] sky.de (de) - SkySportNewsHD.de - Jun 23, 2024 (12 programs)
  [136/150] sky.de (de) - SkySportNewsHD.de - Jun 22, 2024 (17 programs)
  [137/150] sky.de (de) - WarnerTVSerieHD.de - Jun 23, 2024 (31 programs)
  [138/150] sky.de (de) - WarnerTVSerieHD.de - Jun 22, 2024 (30 programs)
  [139/150] sky.de (de) - WarnerTVFilm.de - Jun 23, 2024 (13 programs)
  [140/150] sky.de (de) - WarnerTVComedyHD.de - Jun 22, 2024 (53 programs)
  [141/150] sky.de (de) - SkySportUHD.de - Jun 23, 2024 (23 programs)
  [142/150] sky.de (de) - SkySportTopEventHD.de - Jun 22, 2024 (19 programs)
  [143/150] sky.de (de) - SkySportPremierLeagueHD.de - Jun 22, 2024 (29 programs)
  [144/150] sky.de (de) - SkySportMixHD.de - Jun 23, 2024 (18 programs)
  [145/150] sky.de (de) - WarnerTVFilmHD.de - Jun 23, 2024 (13 programs)
  [146/150] sky.de (de) - UniversalTVHD.de - Jun 23, 2024 (32 programs)
  [147/150] sky.de (de) - SkySportTennisHD.de - Jun 23, 2024 (13 programs)
  [148/150] sky.de (de) - SkySportMixHD.de - Jun 22, 2024 (26 programs)
  [149/150] sky.de (de) - UniversalTVHD.de - Jun 22, 2024 (31 programs)
  [150/150] sky.de (de) - SkySportGolfHD.de - Jun 23, 2024 (8 programs)
  saving to "guide.xml"...
  done in 00h 00m 22s