search

actions / runner-images

GitHub Actions runner images
MIT License
9.77k stars 2.99k forks source link

Github workflow fails as it exhaust all available CPU even if I upgraded on Github Enterprise #10244

Closed ggkiokas closed 1 month ago

ggkiokas commented 1 month ago

Description

Github workflow fails as it exhausts all available CPU even I upgraded on Github Enterprise. Please I need assistance for understanding how I can have larger runners

Platforms affected

Runner images affected

Image version and build link

https://github.com/Seafair/poseidon/actions/runs/9975020032/job/27563828236

Is it regression?

yes

Expected behavior

Workflow should run without problems

Actual behavior

Workflow fails with an error

Repro steps

Please see the logs of this workflow: https://github.com/Seafair/poseidon/actions/runs/9975020032/job/27563828236

Prabhatkumar59 commented 1 month ago

Hi @ggkiokas - Thank you for bringing this issue to us. We are looking into this issue and will update you shortly on this issue after investigating.

ggkiokas commented 1 month ago

Thank you @Prabhatkumar59 ! Please lmk how I can switch to larger runners. I thought by default Github Enterprise plan includes them

Prabhatkumar59 commented 1 month ago

@ggkiokas - Thanks for your response:) In order to switch to larger runners on GitHub Actions, especially when you're facing CPU and disk space limitations, you need to make some configurations. GitHub Enterprise does offer options for larger runners, but you need to explicitly configure your workflows to use them. Below are the detailed steps and options for using larger runners. You can trying using below steps:-

Check Available Runner Sizes: You can verify the available runner sizes in your GitHub Enterprise setup. This information is typically available in your GitHub Enterprise documentation (https://docs.github.com/en/enterprise-server@3.13)

Specify Larger Runners in Workflow: You can also update your GitHub Actions workflow configuration to specify a larger runner.

To make it easier for you, i am providing an example how to specify a larger runner in your workflow configuration:-

name: CI

on: [push, pull_request]

jobs:
  build:
    runs-on: [self-hosted, large]

    steps:
    - name: Checkout
      uses: actions/checkout@v2
    - name: Build
      run: |
        echo "Building the project..."
    - name: Test
      run: |
        echo "Running tests..."

Using Self-Hosted Runners If GitHub-hosted runners are not sufficient, you can use self-hosted runners, which can be configured with more powerful hardware.

A. Set Up Self-Hosted Runners:

Follow the GitHub documentation to set up self-hosted runners: Self-hosted runners.

B. Specify Self-Hosted Runner in Workflow:

Use the runs-on keyword to specify the self-hosted runner.

name: CI

on: [push, pull_request]

jobs:
  build:
    runs-on: self-hosted

    steps:
    - name:

So by using above steps, you can utilize larger runners to ensure your workflows run smoothly without exhausting available CPU or disk space.

ggkiokas commented 1 month ago

Hello @Prabhatkumar59 , thank you so much for your prompt response.

  1. We use gh-actions-hosted runners as Seafair org.

  2. Here in this actions page of my repo I see an available option, of a larger runner but neither me nor the admin of Seafair org can click on it. Do you know how I could do that ? Does this runner comes for free with Github Enterprise plan ?

  3. After having read carefully the documentation for large runners here, it is still not clear to me how I can find labels related with each runner. So I can use them after on my workflow e.g For CPU: 8GB | RAM: 32GB -> runs-on: ubuntu-22.04-large For CPU: 32GB | RAM: 128GB -> runs-on: ubuntu-22.04-x-large

Thanks a lot, I really appreciate your help since I am kinda lost here. Giorgos

Prabhatkumar59 commented 1 month ago

Hi @ggkiokas- Thanks for responding To address your concerns regarding the use of larger GitHub Actions runners within the Seafair organisation, here are some steps and clarifications:-

Availability and Cost:-

Larger runners are typically available for GitHub Enterprise customers, but they may not be enabled by default. You can check with GitHub support to confirm whether your plan includes access to larger runners and any associated costs. Configuring Larger Runners:-

If larger runners are available in your plan, you need to configure them properly in your workflow. The inability to click on the option might be due to permissions or the need for additional setup.

You can also follow below Steps to enable and Use Larger Runners:-

Contact GitHub Support:

You can reach out to GitHub support to ensure that larger runners are enabled for your GitHub Enterprise plan and to clarify any additional steps required. https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners

Assign Labels to Runners: During the setup, assign custom labels to your runners to identify them easily in your workflows.

Example command to configure a self-hosted runner with a custom label ./config.sh --url https://github.com/your-org/your-repo --token YOUR_TOKEN --labels ubuntu-22.04-large

GitHub uses labels to identify and assign runners. The labels for larger runners can vary, so confirming the correct labels with GitHub support or your organization’s admin is crucial.

ggkiokas commented 1 month ago

Hello,

I am trying to add a large gh runner for my workflow. My org belongs to the Enterprise gh plan. I copy the conversation I had with a colleague of yours. Can you please help me with this?

Best regards Giorgos

1.

We use gh-actions-hosted runners as Seafair org. 2.

Here https://github.com/Seafair/poseidon/actions/runners in this actions page of my repo I see an available option, of a larger runner but neither me nor the admin of Seafair org can click on it. Do you know how I could do that ? Does this runner comes for free with Github Enterprise plan ? 3.

After having read carefully the documentation for large runners here @.***/actions/using-github-hosted-runners/about-larger-runners/about-larger-runners#specifications-for-general-larger-runners>, it is still not clear to me how I can find labels related with each runner. So I can use them after on my workflow e.g For CPU: 8GB | RAM: 32GB -> runs-on: ubuntu-22.04-large For CPU: 32GB | RAM: 128GB -> runs-on: ubuntu-22.04-x-large

On Fri, Jul 19, 2024 at 4:05 PM Prabhatkumar59 @.***> wrote:

Hi @ggkiokas- Thanks for responding To address your concerns regarding the use of larger GitHub Actions runners within the Seafair organisation, here are some steps and clarifications:-

Availability and Cost:-

Larger runners are typically available for GitHub Enterprise customers, but they may not be enabled by default. You can check with GitHub support to confirm whether your plan includes access to larger runners and any associated costs. Configuring Larger Runners:-

If larger runners are available in your plan, you need to configure them properly in your workflow. The inability to click on the option might be due to permissions or the need for additional setup.

You can also follow below Steps to enable and Use Larger Runners:-

Contact GitHub Support:

You can reach out to GitHub support to ensure that larger runners are enabled for your GitHub Enterprise plan and to clarify any additional steps required. https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners

Assign Labels to Runners: During the setup, assign custom labels to your runners to identify them easily in your workflows. Example command to configure a self-hosted runner with a custom label

./config.sh --url https://github.com/your-org/your-repo --token YOUR_TOKEN --labels ubuntu-22.04-large

GitHub uses labels to identify and assign runners. The labels for larger runners can vary, so confirming the correct labels with GitHub support or your organization’s admin is crucial.

-

You can also refer to GitHub's documentation https://docs.github.com/en/actions/hosting-your-own-runners/managing-self-hosted-runners/about-self-hosted-runners

Also If you encounter any issues or need further clarification, please feel free to reach out to GitHub support directly or refer to the official documentation. This should help you configure and utilize larger runners effectively within your workflows.

— Reply to this email directly, view it on GitHub https://github.com/actions/runner-images/issues/10244#issuecomment-2239089975, or unsubscribe https://github.com/notifications/unsubscribe-auth/A3QF7QRZTHGXKTDWJILJAA3ZNEFJ5AVCNFSM6AAAAABLAX7FVCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMZZGA4DSOJXGU . You are receiving this because you were mentioned.Message ID: @.***>

ggkiokas commented 1 month ago

Hello @Prabhatkumar59 , Thanks for your answer. Sorry for my previous email but I tried to forward some info on enterprise-support@github.com but without success. Can you please indicate me a way of communicating with gh-support. An email or a url where I can create a ticket ?

Prabhatkumar59 commented 1 month ago

Hi @ggkiokas- The link you shared above(https://github.com/Seafair/poseidon/actions/runners), I do not have access of this actually. So, unable to check.

And in order to contact GitHub Support, you can try using the following methods:-

Contact GitHub Support A. GitHub Support Website:

Visit the GitHub Support page: GitHub Support Choose the relevant option based on your issue (e.g., "Contact Enterprise Support" if you are an Enterprise customer). Fill in the required details and submit your request. B. GitHub Enterprise Support:

If you are a GitHub Enterprise customer, you can directly access support through the GitHub Enterprise Support portal. Visit: GitHub Enterprise Support

C. Email Support:

You can also email GitHub Support at enterprise-support@github.com if you are using GitHub Enterprise.

For you, I am adding an example as well of an Email to GitHub Support:-

To: enterprise-support@github.com
Subject: Assistance Required for Configuring Larger Runners on GitHub Enterprise

Dear GitHub Support Team,

I am writing to seek assistance with configuring larger runners for our workflows in the Seafair organization on GitHub Enterprise. Despite having access to an option for larger runners, neither I nor the admin can enable or click on this option.

Could you please provide guidance on how we can enable and utilize larger runners for our workflows? Specifically, we need information on the correct labels for these runners and any additional steps required to configure them.

Here is a link to our actions page: [GitHub Actions Page](https://github.com/Seafair/poseidon/actions/runners).

Thank you for your assistance.

Best regards,

For Submitting a Ticket via GitHub Support Website:-

A. Visit the Support Page: GitHub Support B. Select the Relevant Option: For GitHub Enterprise: Choose "Contact Enterprise Support." For general support: Choose the appropriate option based on your issue. C. Fill in the Form: You can provide detailed information about your issue. Attach any relevant screenshots or links. D. Then submit your Request.

Following these steps should help you get in touch with GitHub Support and resolve your issue with configuring larger runners. If you have any other questions or need further assistance, feel free to ask!..thanks:)

ggkiokas commented 1 month ago

Thanks a lot @Prabhatkumar59 for your assistance. I emailed enterprise-support@github.com letting them know about my issue. Best regards, Giorgos