m4rs-mt / ILGPU

ILGPU JIT Compiler for high-performance .Net GPU programs
http://www.ilgpu.net
Other
1.34k stars 115 forks source link
amd cil compiler cpu cuda dotnet gpgpu gpgpu-computing gpu ilgpu intel jit kernels msil nvidia opencl parallel ptx

ILGPU

CI

ILGPU is a JIT (just-in-time) compiler for high-performance GPU programs written in .Net-based languages. ILGPU is entirely written in C# without any native dependencies. It offers the flexibility and the convenience of C++ AMP on the one hand and the high performance of Cuda programs on the other hand. Functions in the scope of kernels do not have to be annotated (default C# functions) and are allowed to work on value types. All kernels (including all hardware features like shared memory and atomics) can be executed and debugged on the CPU using the integrated multi-threaded CPU accelerator.

ILGPU.Algorithms

Real-world applications typically require a standard library and a set of standard algorithms that "simply work". The ILGPU Algorithms library meets these requirements by offering a set of auxiliary functions and high-level algorithms (e.g. sorting or prefix sum). All algorithms can be run on all supported accelerator types. The CPU accelerator support is especially useful for kernel debugging.

Community

Discord

The ILGPU community provides immediate help, feedback and suggestions via Discord ASAP. Log on to the server and you can get started right away.

There are weekly talk-to-dev meetings on the Discord server. Don't hesitate to join the meeting if you have any questions or suggestions or just want to talk to one of the contributors. Check out the welcome channel on our Discord server for more information.

ILGPU Samples

The sample projects demonstrate the basic usage of ILGPU to help you get started with high performance GPU programming.

Build Instructions

ILGPU requires Visual Studio 2022 (or higher) and/or a .NET 6.0 SDK toolchain.

Use the provided Visual Studio solution to build the ILGPU libs in the desired configurations (Debug/Release).

Tests

Sometimes the XUnit test runner stops execution when all tests are run in parallel. This is not a problem related to the internal tests, but a known XUnit/Visual Studio problem. If the tests stop unexpectedly, you can simply run the remaining tests again to continue working.

Note: You can unload ILGPU.Tests.Cuda (for example) if you do not have a Cuda-capable device to execute the Cuda test cases.

Related Information

Preview versions

Preview/Daily builds are distributed using https://feedz.io/. To pull preview versions into your project, use the following NuGet.config file:

<?xml version="1.0" encoding="utf-8"?>
<configuration>
  <packageSources>
    <add key="ilgpu" value="https://f.feedz.io/ilgpu/preview/nuget/index.json" />
  </packageSources>
</configuration>

Symbols

Symbols for ILGPU can be loaded in VS2022. For official releases, ensure that the built-in NuGet.org Symbol Server is enabled. For preview release symbols, add the link:

https://f.feedz.io/ilgpu/preview/symbols

Source Link

ILGPU also provides Source Link support for a better debugging experience. Make sure Enable Source Link support is activated in VS2022 options.

General Contribution Guidelines

References

License information

ILGPU is licensed under the University of Illinois/NCSA Open Source License. Detailed license information can be found in LICENSE.txt.

Copyright (c) 2016-2024 ILGPU Project. All rights reserved.

Originally developed by Marcel Koester.

License information of required dependencies

Different parts of ILGPU require different third-party libraries.

Detailed copyright and license information of these dependencies can be found in LICENSE-3RD-PARTY.txt.