search

azu / rss-to-twitter

GitHub Actions: RSS to Twitter
MIT License
41 stars 9 forks source link

Status code 403 on working RSS feed #1

Open RyanLua opened 8 months ago

RyanLua commented 8 months ago

Describe the bug: バグの概要

Whenever I have the RSS_URL set to "https://devforum.roblox.com/c/help-and-feedback/54.rss" I an error code of 403 forbidden when the feed works fine. You can see on my RSS.app feed that it is able to get the feed line and visiting the URL shows a feed as expected.

To Reproduce: 再現手順

Steps to reproduce the behavior:

  1. Create a workflow using azu/rss-to-twitter@v1
  2. Set RSS_URL to "https://devforum.roblox.com/c/help-and-feedback/54.rss"
  3. Run the workflow and notice it always gives 403 error

Expected behavior: 期待する動作

When you set the RSS_URL to a valid RSS URL it should work instead of being forbidden.

Screenshots: スクリーンショット

image image image

Operating environment: バグが発生した環境

Additional context: 補足

Workflow file

name: rss-to-twitter
on:
  schedule:
    # every hour
    - cron: "0 * * * *"
  workflow_dispatch:
jobs:
  twitter:
    runs-on: ubuntu-latest
    steps:
      - uses: azu/rss-to-twitter@v1
        with:
          # RSS feed URL
          RSS_URL: "https://devforum.roblox.com/c/help-and-feedback/54.rss"
          TWEET_TEMPLATE: '"%title%"\n\n%desc%\n\n#RobloxDev\n%url%'
          UPDATE_WITHIN_MINUTES: 15 # for workflow_dispatch
          TWITTER_APIKEY: ${{ secrets.CONSUMER_SECRET }}
          TWITTER_APIKEY_SECRET: ${{ secrets.TWITTER_APIKEY_SECRET }}
          TWITTER_ACCESS_TOKEN: ${{ secrets.ACCESS_TOKEN }}
          TWITTER_ACCESS_TOKEN_SECRET: ${{ secrets.ACCESS_TOKEN_SECRET }}

Workflow raw log

2024-02-11T08:17:28.0422141Z Requested labels: ubuntu-latest
2024-02-11T08:17:28.0422447Z Job defined at: RyanLua/devforum-to-twitter/.github/workflows/rss-to-twitter.yml@refs/heads/main
2024-02-11T08:17:28.0422604Z Waiting for a runner to pick up this job...
2024-02-11T08:17:28.5340403Z Job is waiting for a hosted runner to come online.
2024-02-11T08:17:31.3935405Z Job is about to start running on the hosted runner: GitHub Actions 24 (hosted)
2024-02-11T08:17:33.4065670Z Current runner version: '2.312.0'
2024-02-11T08:17:33.4095666Z ##[group]Operating System
2024-02-11T08:17:33.4096657Z Ubuntu
2024-02-11T08:17:33.4097134Z 22.04.3
2024-02-11T08:17:33.4097590Z LTS
2024-02-11T08:17:33.4098130Z ##[endgroup]
2024-02-11T08:17:33.4098649Z ##[group]Runner Image
2024-02-11T08:17:33.4099253Z Image: ubuntu-22.04
2024-02-11T08:17:33.4099830Z Version: 20240204.1.0
2024-02-11T08:17:33.4101181Z Included Software: https://github.com/actions/runner-images/blob/ubuntu22/20240204.1/images/ubuntu/Ubuntu2204-Readme.md
2024-02-11T08:17:33.4103091Z Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu22%2F20240204.1
2024-02-11T08:17:33.4104304Z ##[endgroup]
2024-02-11T08:17:33.4104868Z ##[group]Runner Image Provisioner
2024-02-11T08:17:33.4105579Z 2.0.341.1
2024-02-11T08:17:33.4106050Z ##[endgroup]
2024-02-11T08:17:33.4107339Z ##[group]GITHUB_TOKEN Permissions
2024-02-11T08:17:33.4109367Z Contents: read
2024-02-11T08:17:33.4109944Z Metadata: read
2024-02-11T08:17:33.4110838Z Packages: read
2024-02-11T08:17:33.4111468Z ##[endgroup]
2024-02-11T08:17:33.4115547Z Secret source: Actions
2024-02-11T08:17:33.4116345Z Prepare workflow directory
2024-02-11T08:17:33.4856920Z Prepare all required actions
2024-02-11T08:17:33.5047063Z Getting action download info
2024-02-11T08:17:33.7013309Z Download action repository 'azu/rss-to-twitter@v1' (SHA:f20e6ba3ed2dc03d86578775a5d2a3afb5bff966)
2024-02-11T08:17:34.6913409Z Complete job name: twitter
2024-02-11T08:17:34.8009777Z ##[group]Run azu/rss-to-twitter@v1
2024-02-11T08:17:34.8010476Z with:
2024-02-11T08:17:34.8011145Z   RSS_URL: https://devforum.roblox.com/c/help-and-feedback/54.rss
2024-02-11T08:17:34.8012202Z   TWEET_TEMPLATE: "%title%"\n\n%desc%\n\n#RobloxDev\n%url%
2024-02-11T08:17:34.8013001Z   UPDATE_WITHIN_MINUTES: 15
2024-02-11T08:17:34.8014056Z   TWITTER_APIKEY: ***
2024-02-11T08:17:34.8014905Z   TWITTER_ACCESS_TOKEN: ***
2024-02-11T08:17:34.8015869Z   TWITTER_ACCESS_TOKEN_SECRET: ***
2024-02-11T08:17:34.8016456Z ##[endgroup]
2024-02-11T08:17:35.1197509Z 
2024-02-11T08:17:35.1200536Z ==================================================
2024-02-11T08:17:35.1201777Z Event:    workflow_dispatch
2024-02-11T08:17:35.1202265Z Action:   undefined
2024-02-11T08:17:35.1202804Z sha:      6cd9bce3eea60424e609f19f53c6b1ba33153667
2024-02-11T08:17:35.1203450Z ref:      refs/heads/main
2024-02-11T08:17:35.1203898Z owner:    RyanLua
2024-02-11T08:17:35.1204531Z repo:     devforum-to-twitter
2024-02-11T08:17:35.1204989Z 
2024-02-11T08:17:35.1235118Z ##[group]Dump context
2024-02-11T08:17:35.1237653Z Context {
2024-02-11T08:17:35.1237980Z   payload: {
2024-02-11T08:17:35.1238325Z     inputs: null,
2024-02-11T08:17:35.1238817Z     ref: 'refs/heads/main',
2024-02-11T08:17:35.1239242Z     repository: {
2024-02-11T08:17:35.1239605Z       allow_forking: true,
2024-02-11T08:17:35.1240567Z       archive_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/{archive_format}{/ref}',
2024-02-11T08:17:35.1241466Z       archived: false,
2024-02-11T08:17:35.1242346Z       assignees_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/assignees{/user}',
2024-02-11T08:17:35.1243661Z       blobs_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/blobs{/sha}',
2024-02-11T08:17:35.1244986Z       branches_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/branches{/branch}',
2024-02-11T08:17:35.1246413Z       clone_url: 'https://github.com/RyanLua/devforum-to-twitter.git',
2024-02-11T08:17:35.1247875Z       collaborators_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/collaborators{/collaborator}',
2024-02-11T08:17:35.1249506Z       comments_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/comments{/number}',
2024-02-11T08:17:35.1250934Z       commits_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/commits{/sha}',
2024-02-11T08:17:35.1252385Z       compare_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/compare/{base}...{head}',
2024-02-11T08:17:35.1253923Z       contents_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/contents/{+path}',
2024-02-11T08:17:35.1255776Z       contributors_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/contributors',
2024-02-11T08:17:35.1256832Z       created_at: '2024-02-09T09:04:42Z',
2024-02-11T08:17:35.1257499Z       default_branch: 'main',
2024-02-11T08:17:35.1258499Z       deployments_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/deployments',
2024-02-11T08:17:35.1259731Z       description: null,
2024-02-11T08:17:35.1260337Z       disabled: false,
2024-02-11T08:17:35.1261255Z       downloads_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/downloads',
2024-02-11T08:17:35.1262623Z       events_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/events',
2024-02-11T08:17:35.1263572Z       fork: false,
2024-02-11T08:17:35.1264026Z       forks: 0,
2024-02-11T08:17:35.1264513Z       forks_count: 0,
2024-02-11T08:17:35.1265381Z       forks_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/forks',
2024-02-11T08:17:35.1266376Z       full_name: 'RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1267599Z       git_commits_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/commits{/sha}',
2024-02-11T08:17:35.1269026Z       git_refs_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/refs{/sha}',
2024-02-11T08:17:35.1270617Z       git_tags_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/tags{/sha}',
2024-02-11T08:17:35.1271893Z       git_url: 'git://github.com/RyanLua/devforum-to-twitter.git',
2024-02-11T08:17:35.1272760Z       has_discussions: false,
2024-02-11T08:17:35.1273411Z       has_downloads: true,
2024-02-11T08:17:35.1273882Z       has_issues: false,
2024-02-11T08:17:35.1274383Z       has_pages: false,
2024-02-11T08:17:35.1274947Z       has_projects: false,
2024-02-11T08:17:35.1275452Z       has_wiki: false,
2024-02-11T08:17:35.1275939Z       homepage: null,
2024-02-11T08:17:35.1276855Z       hooks_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/hooks',
2024-02-11T08:17:35.1277962Z       html_url: 'https://github.com/RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1278666Z       id: 755018241,
2024-02-11T08:17:35.1279207Z       is_template: false,
2024-02-11T08:17:35.1280290Z       issue_comment_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/issues/comments{/number}',
2024-02-11T08:17:35.1281914Z       issue_events_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/issues/events{/number}',
2024-02-11T08:17:35.1283458Z       issues_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/issues{/number}',
2024-02-11T08:17:35.1284820Z       keys_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/keys{/key_id}',
2024-02-11T08:17:35.1286210Z       labels_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/labels{/name}',
2024-02-11T08:17:35.1287130Z       language: null,
2024-02-11T08:17:35.1288005Z       languages_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/languages',
2024-02-11T08:17:35.1288980Z       license: null,
2024-02-11T08:17:35.1289848Z       merges_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/merges',
2024-02-11T08:17:35.1291232Z       milestones_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/milestones{/number}',
2024-02-11T08:17:35.1292293Z       mirror_url: null,
2024-02-11T08:17:35.1292879Z       name: 'devforum-to-twitter',
2024-02-11T08:17:35.1293536Z       node_id: 'R_kgDOLQCqAQ',
2024-02-11T08:17:35.1294861Z       notifications_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/notifications{?since,all,participating}',
2024-02-11T08:17:35.1295971Z       open_issues: 0,
2024-02-11T08:17:35.1296463Z       open_issues_count: 0,
2024-02-11T08:17:35.1297042Z       owner: [Object],
2024-02-11T08:17:35.1297524Z       private: true,
2024-02-11T08:17:35.1298498Z       pulls_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/pulls{/number}',
2024-02-11T08:17:35.1299529Z       pushed_at: '2024-02-11T08:08:02Z',
2024-02-11T08:17:35.1300778Z       releases_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/releases{/id}',
2024-02-11T08:17:35.1301733Z       size: 7,
2024-02-11T08:17:35.1302438Z       ssh_url: 'git@github.com:RyanLua/devforum-to-twitter.git',
2024-02-11T08:17:35.1303181Z       stargazers_count: 0,
2024-02-11T08:17:35.1304217Z       stargazers_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/stargazers',
2024-02-11T08:17:35.1305604Z       statuses_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/statuses/{sha}',
2024-02-11T08:17:35.1307003Z       subscribers_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/subscribers',
2024-02-11T08:17:35.1308475Z       subscription_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/subscription',
2024-02-11T08:17:35.1309655Z       svn_url: 'https://github.com/RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1310802Z       tags_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/tags',
2024-02-11T08:17:35.1311966Z       teams_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/teams',
2024-02-11T08:17:35.1313219Z       topics: [],
2024-02-11T08:17:35.1314230Z       trees_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/trees{/sha}',
2024-02-11T08:17:35.1315281Z       updated_at: '2024-02-11T08:08:12Z',
2024-02-11T08:17:35.1316349Z       url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1317271Z       visibility: 'private',
2024-02-11T08:17:35.1317809Z       watchers: 0,
2024-02-11T08:17:35.1318228Z       watchers_count: 0,
2024-02-11T08:17:35.1318823Z       web_commit_signoff_required: false
2024-02-11T08:17:35.1319412Z     },
2024-02-11T08:17:35.1319814Z     sender: {
2024-02-11T08:17:35.1320629Z       avatar_url: 'https://avatars.githubusercontent.com/u/80087248?v=4',
2024-02-11T08:17:35.1321749Z       events_url: 'https://api.github.com/users/RyanLua/events{/privacy}',
2024-02-11T08:17:35.1322889Z       followers_url: 'https://api.github.com/users/RyanLua/followers',
2024-02-11T08:17:35.1324077Z       following_url: 'https://api.github.com/users/RyanLua/following{/other_user}',
2024-02-11T08:17:35.1325204Z       gists_url: 'https://api.github.com/users/RyanLua/gists{/gist_id}',
2024-02-11T08:17:35.1326083Z       gravatar_id: '',
2024-02-11T08:17:35.1326661Z       html_url: 'https://github.com/RyanLua',
2024-02-11T08:17:35.1327289Z       id: 80087248,
2024-02-11T08:17:35.1327861Z       login: 'RyanLua',
2024-02-11T08:17:35.1328446Z       node_id: 'MDQ6VXNlcjgwMDg3MjQ4',
2024-02-11T08:17:35.1329312Z       organizations_url: 'https://api.github.com/users/RyanLua/orgs',
2024-02-11T08:17:35.1330508Z       received_events_url: 'https://api.github.com/users/RyanLua/received_events',
2024-02-11T08:17:35.1331567Z       repos_url: 'https://api.github.com/users/RyanLua/repos',
2024-02-11T08:17:35.1332239Z       site_admin: false,
2024-02-11T08:17:35.1333180Z       starred_url: 'https://api.github.com/users/RyanLua/starred{/owner}{/repo}',
2024-02-11T08:17:35.1334366Z       subscriptions_url: 'https://api.github.com/users/RyanLua/subscriptions',
2024-02-11T08:17:35.1335298Z       type: 'User',
2024-02-11T08:17:35.1335907Z       url: 'https://api.github.com/users/RyanLua'
2024-02-11T08:17:35.1336538Z     },
2024-02-11T08:17:35.1337194Z     workflow: '.github/workflows/rss-to-twitter.yml'
2024-02-11T08:17:35.1337843Z   },
2024-02-11T08:17:35.1338278Z   eventName: 'workflow_dispatch',
2024-02-11T08:17:35.1339086Z   sha: '6cd9bce3eea60424e609f19f53c6b1ba33153667',
2024-02-11T08:17:35.1339808Z   ref: 'refs/heads/main',
2024-02-11T08:17:35.1340386Z   workflow: 'rss-to-twitter',
2024-02-11T08:17:35.1341079Z   action: '__azu_rss-to-twitter',
2024-02-11T08:17:35.1341665Z   actor: 'RyanLua',
2024-02-11T08:17:35.1342124Z   job: 'twitter',
2024-02-11T08:17:35.1342638Z   runNumber: 26,
2024-02-11T08:17:35.1343097Z   runId: 7860660560,
2024-02-11T08:17:35.1343730Z   apiUrl: 'https://api.github.com',
2024-02-11T08:17:35.1344590Z   serverUrl: 'https://github.com',
2024-02-11T08:17:35.1345321Z   graphqlUrl: 'https://api.github.com/graphql'
2024-02-11T08:17:35.1346017Z }
2024-02-11T08:17:35.1347047Z ##[endgroup]
2024-02-11T08:17:35.1347919Z ##[group]Dump Payload
2024-02-11T08:17:35.1348404Z {
2024-02-11T08:17:35.1348799Z   inputs: null,
2024-02-11T08:17:35.1349381Z   ref: 'refs/heads/main',
2024-02-11T08:17:35.1349880Z   repository: {
2024-02-11T08:17:35.1350300Z     allow_forking: true,
2024-02-11T08:17:35.1351410Z     archive_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/{archive_format}{/ref}',
2024-02-11T08:17:35.1352407Z     archived: false,
2024-02-11T08:17:35.1353606Z     assignees_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/assignees{/user}',
2024-02-11T08:17:35.1355030Z     blobs_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/blobs{/sha}',
2024-02-11T08:17:35.1356457Z     branches_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/branches{/branch}',
2024-02-11T08:17:35.1357788Z     clone_url: 'https://github.com/RyanLua/devforum-to-twitter.git',
2024-02-11T08:17:35.1359186Z     collaborators_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/collaborators{/collaborator}',
2024-02-11T08:17:35.1360701Z     comments_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/comments{/number}',
2024-02-11T08:17:35.1362351Z     commits_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/commits{/sha}',
2024-02-11T08:17:35.1363815Z     compare_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/compare/{base}...{head}',
2024-02-11T08:17:35.1365339Z     contents_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/contents/{+path}',
2024-02-11T08:17:35.1366829Z     contributors_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/contributors',
2024-02-11T08:17:35.1367857Z     created_at: '2024-02-09T09:04:42Z',
2024-02-11T08:17:35.1368569Z     default_branch: 'main',
2024-02-11T08:17:35.1369555Z     deployments_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/deployments',
2024-02-11T08:17:35.1370545Z     description: null,
2024-02-11T08:17:35.1371046Z     disabled: false,
2024-02-11T08:17:35.1371960Z     downloads_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/downloads',
2024-02-11T08:17:35.1373256Z     events_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/events',
2024-02-11T08:17:35.1374183Z     fork: false,
2024-02-11T08:17:35.1374637Z     forks: 0,
2024-02-11T08:17:35.1375085Z     forks_count: 0,
2024-02-11T08:17:35.1375979Z     forks_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/forks',
2024-02-11T08:17:35.1376919Z     full_name: 'RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1378051Z     git_commits_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/commits{/sha}',
2024-02-11T08:17:35.1379541Z     git_refs_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/refs{/sha}',
2024-02-11T08:17:35.1380945Z     git_tags_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/tags{/sha}',
2024-02-11T08:17:35.1382196Z     git_url: 'git://github.com/RyanLua/devforum-to-twitter.git',
2024-02-11T08:17:35.1382972Z     has_discussions: false,
2024-02-11T08:17:35.1383502Z     has_downloads: true,
2024-02-11T08:17:35.1384064Z     has_issues: false,
2024-02-11T08:17:35.1384515Z     has_pages: false,
2024-02-11T08:17:35.1384999Z     has_projects: false,
2024-02-11T08:17:35.1385563Z     has_wiki: false,
2024-02-11T08:17:35.1386045Z     homepage: null,
2024-02-11T08:17:35.1386881Z     hooks_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/hooks',
2024-02-11T08:17:35.1388034Z     html_url: 'https://github.com/RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1388790Z     id: 755018241,
2024-02-11T08:17:35.1389201Z     is_template: false,
2024-02-11T08:17:35.1390345Z     issue_comment_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/issues/comments{/number}',
2024-02-11T08:17:35.1391933Z     issue_events_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/issues/events{/number}',
2024-02-11T08:17:35.1393784Z     issues_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/issues{/number}',
2024-02-11T08:17:35.1395137Z     keys_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/keys{/key_id}',
2024-02-11T08:17:35.1396469Z     labels_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/labels{/name}',
2024-02-11T08:17:35.1397456Z     language: null,
2024-02-11T08:17:35.1398360Z     languages_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/languages',
2024-02-11T08:17:35.1399219Z     license: null,
2024-02-11T08:17:35.1503676Z     merges_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/merges',
2024-02-11T08:17:35.1505168Z     milestones_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/milestones{/number}',
2024-02-11T08:17:35.1506065Z     mirror_url: null,
2024-02-11T08:17:35.1506518Z     name: 'devforum-to-twitter',
2024-02-11T08:17:35.1507037Z     node_id: 'R_kgDOLQCqAQ',
2024-02-11T08:17:35.1508163Z     notifications_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/notifications{?since,all,participating}',
2024-02-11T08:17:35.1509213Z     open_issues: 0,
2024-02-11T08:17:35.1509576Z     open_issues_count: 0,
2024-02-11T08:17:35.1509954Z     owner: {
2024-02-11T08:17:35.1510595Z       avatar_url: 'https://avatars.githubusercontent.com/u/80087248?v=4',
2024-02-11T08:17:35.1511855Z       events_url: 'https://api.github.com/users/RyanLua/events{/privacy}',
2024-02-11T08:17:35.1513031Z       followers_url: 'https://api.github.com/users/RyanLua/followers',
2024-02-11T08:17:35.1514045Z       following_url: 'https://api.github.com/users/RyanLua/following{/other_user}',
2024-02-11T08:17:35.1515064Z       gists_url: 'https://api.github.com/users/RyanLua/gists{/gist_id}',
2024-02-11T08:17:35.1515765Z       gravatar_id: '',
2024-02-11T08:17:35.1516260Z       html_url: 'https://github.com/RyanLua',
2024-02-11T08:17:35.1516775Z       id: 80087248,
2024-02-11T08:17:35.1517158Z       login: 'RyanLua',
2024-02-11T08:17:35.1517626Z       node_id: 'MDQ6VXNlcjgwMDg3MjQ4',
2024-02-11T08:17:35.1518366Z       organizations_url: 'https://api.github.com/users/RyanLua/orgs',
2024-02-11T08:17:35.1519370Z       received_events_url: 'https://api.github.com/users/RyanLua/received_events',
2024-02-11T08:17:35.1520309Z       repos_url: 'https://api.github.com/users/RyanLua/repos',
2024-02-11T08:17:35.1520919Z       site_admin: false,
2024-02-11T08:17:35.1521645Z       starred_url: 'https://api.github.com/users/RyanLua/starred{/owner}{/repo}',
2024-02-11T08:17:35.1522697Z       subscriptions_url: 'https://api.github.com/users/RyanLua/subscriptions',
2024-02-11T08:17:35.1523438Z       type: 'User',
2024-02-11T08:17:35.1523924Z       url: 'https://api.github.com/users/RyanLua'
2024-02-11T08:17:35.1524426Z     },
2024-02-11T08:17:35.1524725Z     private: true,
2024-02-11T08:17:35.1525503Z     pulls_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/pulls{/number}',
2024-02-11T08:17:35.1526392Z     pushed_at: '2024-02-11T08:08:02Z',
2024-02-11T08:17:35.1527296Z     releases_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/releases{/id}',
2024-02-11T08:17:35.1528105Z     size: 7,
2024-02-11T08:17:35.1528653Z     ssh_url: 'git@github.com:RyanLua/devforum-to-twitter.git',
2024-02-11T08:17:35.1529275Z     stargazers_count: 0,
2024-02-11T08:17:35.1530085Z     stargazers_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/stargazers',
2024-02-11T08:17:35.1531332Z     statuses_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/statuses/{sha}',
2024-02-11T08:17:35.1532606Z     subscribers_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/subscribers',
2024-02-11T08:17:35.1533892Z     subscription_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/subscription',
2024-02-11T08:17:35.1534948Z     svn_url: 'https://github.com/RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1535903Z     tags_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/tags',
2024-02-11T08:17:35.1537153Z     teams_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/teams',
2024-02-11T08:17:35.1537884Z     topics: [],
2024-02-11T08:17:35.1538669Z     trees_url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter/git/trees{/sha}',
2024-02-11T08:17:35.1539556Z     updated_at: '2024-02-11T08:08:12Z',
2024-02-11T08:17:35.1540309Z     url: 'https://api.github.com/repos/RyanLua/devforum-to-twitter',
2024-02-11T08:17:35.1541020Z     visibility: 'private',
2024-02-11T08:17:35.1541401Z     watchers: 0,
2024-02-11T08:17:35.1541742Z     watchers_count: 0,
2024-02-11T08:17:35.1542146Z     web_commit_signoff_required: false
2024-02-11T08:17:35.1542594Z   },
2024-02-11T08:17:35.1542873Z   sender: {
2024-02-11T08:17:35.1543498Z     avatar_url: 'https://avatars.githubusercontent.com/u/80087248?v=4',
2024-02-11T08:17:35.1544483Z     events_url: 'https://api.github.com/users/RyanLua/events{/privacy}',
2024-02-11T08:17:35.1545421Z     followers_url: 'https://api.github.com/users/RyanLua/followers',
2024-02-11T08:17:35.1546422Z     following_url: 'https://api.github.com/users/RyanLua/following{/other_user}',
2024-02-11T08:17:35.1547424Z     gists_url: 'https://api.github.com/users/RyanLua/gists{/gist_id}',
2024-02-11T08:17:35.1548115Z     gravatar_id: '',
2024-02-11T08:17:35.1548589Z     html_url: 'https://github.com/RyanLua',
2024-02-11T08:17:35.1549208Z     id: 80087248,
2024-02-11T08:17:35.1549591Z     login: 'RyanLua',
2024-02-11T08:17:35.1550050Z     node_id: 'MDQ6VXNlcjgwMDg3MjQ4',
2024-02-11T08:17:35.1550781Z     organizations_url: 'https://api.github.com/users/RyanLua/orgs',
2024-02-11T08:17:35.1551779Z     received_events_url: 'https://api.github.com/users/RyanLua/received_events',
2024-02-11T08:17:35.1552915Z     repos_url: 'https://api.github.com/users/RyanLua/repos',
2024-02-11T08:17:35.1553524Z     site_admin: false,
2024-02-11T08:17:35.1555229Z     starred_url: 'https://api.github.com/users/RyanLua/starred{/owner}{/repo}',
2024-02-11T08:17:35.1556335Z     subscriptions_url: 'https://api.github.com/users/RyanLua/subscriptions',
2024-02-11T08:17:35.1557081Z     type: 'User',
2024-02-11T08:17:35.1557550Z     url: 'https://api.github.com/users/RyanLua'
2024-02-11T08:17:35.1558060Z   },
2024-02-11T08:17:35.1558503Z   workflow: '.github/workflows/rss-to-twitter.yml'
2024-02-11T08:17:35.1559035Z }
2024-02-11T08:17:35.1559683Z ##[endgroup]
2024-02-11T08:17:35.1560053Z ==================================================
2024-02-11T08:17:35.1560436Z 
2024-02-11T08:17:35.1561199Z ##[group]fetch rss feed: https://devforum.roblox.com/c/help-and-feedback/54.rss
2024-02-11T08:17:35.2876847Z Error: Status code 403
2024-02-11T08:17:35.2878456Z     at ClientRequest.<anonymous> (/home/runner/work/_actions/azu/rss-to-twitter/v1/lib/main.js:109220:25)
2024-02-11T08:17:35.2879586Z     at Object.onceWrapper (node:events:628:26)
2024-02-11T08:17:35.2880275Z     at ClientRequest.emit (node:events:513:28)
2024-02-11T08:17:35.2881129Z     at HTTPParser.parserOnIncomingClient (node:_http_client:693:27)
2024-02-11T08:17:35.2882201Z     at HTTPParser.parserOnHeadersComplete (node:_http_common:128:17)
2024-02-11T08:17:35.2883188Z     at TLSSocket.socketOnData (node:_http_client:534:22)
2024-02-11T08:17:35.2883905Z     at TLSSocket.emit (node:events:513:28)
2024-02-11T08:17:35.2884587Z     at addChunk (node:internal/streams/readable:315:12)
2024-02-11T08:17:35.2885440Z     at readableAddChunk (node:internal/streams/readable:289:9)
2024-02-11T08:17:35.2886403Z     at TLSSocket.Readable.push (node:internal/streams/readable:228:10)
2024-02-11T08:17:35.2923377Z ##[error]Status code 403
2024-02-11T08:17:35.3299206Z Cleaning up orphan processes
Just noticed that my UPDATE_WITHIN_MINUTES isn't set properly. Fixing that still doesn't fix the 403 error.
azu commented 8 months ago 
curl https://devforum.roblox.com/c/help-and-feedback/54.rss -v
< HTTP/2 403
< server: AkamaiGHost

I think the access is probably being cut off by some user agent or some headers.

Fetch Point:

https://github.com/azu/rss-to-twitter/blob/aff320f38e4916c3c9c8f303410b5a6721be97ba/src/process.ts#L15

We can pass Headers, but I don't know how to avoid this.

RyanLua commented 8 months ago

When I run this on a self-hosted runner with a residential IP (my laptop server), it returns 403. So you're probably right about needing to pass some headers but I've been figuring out what exact headers.

I used GitHub Codespaces to run curl and was about to reproduce the 403 there. Unfortunately passing user agents don't seem to result in anything but 403. Any ideas?