NixOS / nixpkgs

Nix Packages collection & NixOS
MIT License
16.49k stars 12.99k forks source link

UE5 (Unreal Engine 5 Game Engine) #124963

Open Ashe opened 3 years ago

Ashe commented 3 years ago

Project description Now that we have access to Unreal Engine 5's source code, it would be nice to have a ue5 package which corresponds to the main branch of UE5 ue5-main.

The quick start documentation shows some steps to getting it working, however as a NixOS newbie I got stuck when it begun requiring things of dotnet (I also wasn't making a package which was just making my life more difficult).

Apparently the stages to get this setup are:

  1. Clone the branch
  2. Run Setup.sh in the root folder
  3. Run GenerateProjectFiles.sh in the root folder
  4. Run make

Some things to note:

Would love to see this! Thank you!

Metadata

prusnak commented 3 years ago

Now that we have access to Unreal Engine 5's source code

Who is "we"? The repo https://github.com/EpicGames/UnrealEngine is not public

Ashe commented 3 years ago

Now that we have access to Unreal Engine 5's source code

Who is "we"? The repo https://github.com/EpicGames/UnrealEngine is not public

You can get access to UE source code by connecting your GitHub with them. I don't like it, but it is open to anybody who wants it. I presume it's what we do with the UE4 package:

https://github.com/NixOS/nixpkgs/blob/nixos-20.09/pkgs/games/ue4/default.nix#L76

url = "https://github.com/EpicGames/UnrealEngine/releases/tag/${version}"; - same repo, just on the UE5 branch rather than ue4.

juliosueiras commented 3 years ago

I am taking a jab at ue5 right now, there is quite a few changes compare to UE4 like introduction of bundled tooling(which require some modification to bypass), I am hoping within today/tomorrow I will have a working version of it (since it also require nuget packages as well now)

juliosueiras commented 3 years ago

some progress update, dividing the process to execute GitDeps as its own derivation, due to the massive unpacking it does

juliosueiras commented 3 years ago

so, the current big issue with both UE5 and latest UE4 is that everything is self-bundled(in a hardcoded fashion), currently trying buildFHSUserEnv approach(for now to get it building), will most likely have more progress mid june once getting new equipment, due to the high process power and storage space that UE5 need

juliosueiras commented 3 years ago

(to give perspective, I split the process of GitDeps and that result in 42GB of deps)

IvarWithoutBones commented 3 years ago

Their scripts use /bin/bash which need changing to be /bin/sh (or maybe there's a better way of doing this with Nix)

Just wanted to add that the patchShebangs function can do this, see for example: https://github.com/NixOS/nixpkgs/blob/8284fc30c84ea47e63209d1a892aca1dfcd6bdf3/pkgs/applications/office/bookworm/default.nix#L57

juliosueiras commented 3 years ago

will be posting progress by the end of the week

juliosueiras commented 3 years ago

Screenshot from 2021-06-19 05-24-54 Screenshot from 2021-06-19 05-26-58

the current progress, pretty much done for first passthrough, this is via nix's clang not the bundled clang, going spend the next week to convert to pure drv

Ashe commented 3 years ago

Absolutely fantastic work, cannot wait to have this on my machine!

juliosueiras commented 3 years ago

initial basic check list:

loucass003 commented 3 years ago

Any updates on this ?

juliosueiras commented 3 years ago

@loucass003 working on it, the only main component left is the compilation process issue for C++ based projects and exporting, but aside from that, everything else is working fine so far(blueprint, animation, etc) I am just taking a few days to not get burnt out

juliosueiras commented 3 years ago

will be resume working on it tomorrow(was busy with work the past week)

loucass003 commented 2 years ago

Still nothing ? :cry:

juliosueiras commented 2 years ago

Still nothing ? 😢

Still working on it , mostly the current issue is to fix the hardcore path and have a full start to finish build both a C++ project(both GUI and via make) and a Blueprint project

loucass003 commented 2 years ago

Still nothing ? 😢

Still working on it , mostly the current issue is to fix the hardcore path and have a full start to finish build both a C++ project(both GUI and via make) and a Blueprint project

Ok cool, thanks for your work on it!

juliosueiras commented 2 years ago

will see if I can start creating the draft PR this weekend

Ashe commented 2 years ago

will see if I can start creating the draft PR this weekend

Thank you for your hard work, you must have put a lot of effort into this!

dyaso commented 2 years ago

Any hope whatever's working so far could be published, even without an official PR?

juliosueiras commented 2 years ago

@dyaso yea, was mostly waiting for UE5 to be more stable, and will be resuming on it since now have access to a high-memory server farm for building it(since UE5 packaging is not exactly a easy one desktop situation)

iblech commented 2 years ago

Just wanted to thank you @juliosueiras for your hard work, very much appreciated :-)

PAI5REECHO commented 2 years ago

Make a draft PR, I'll be happy to contribute build system fixes

jerith666 commented 2 years ago

I poked around under his github account and found https://github.com/juliosueiras-nix/nix-ue5. It just has one commit from 2021-06-23, but might be something of a starting point.

juliosueiras commented 2 years ago

@jerith666 will push the new update, the current hurdle is mostly boil down to way UE package its games and its cmake lookup,etc (the engine itself can run and do stuff with no problem)

juliosueiras commented 2 years ago

will be creating the draft PR tonight/tomorrow

juliosueiras commented 2 years ago

juliosueiras commented 2 years ago

Screenshot from 2022-04-23 16-57-27 Screenshot from 2022-04-23 16-59-56

Screenshot from 2022-04-23 17-01-17

juliosueiras commented 2 years ago

C++ based project was able to open(needed to tweak a few things)

juliosueiras commented 2 years ago

Screenshot from 2022-04-24 18-06-32 Screenshot from 2022-04-24 17-45-20 Quick Launch work now(needed a few tweak) first pic is Blueprint based project second pic is C++ based project

will be postponing the submit to tomorrow, since I am downloading the City sample to test an actual production project load just to make sure before writing the draft PR Screenshot from 2022-04-24 18-34-22

juliosueiras commented 2 years ago

FYI is annoying that I need to use Epic Game Launcher(wine) to download marketplace asset/project

juliosueiras commented 2 years ago

Nevermind, doing the Content Showcase project instead, since City Sample is killing my bandwidth(in term of throttle)

juliosueiras commented 2 years ago

k, tested all aspect of the Content showcase, no severe issue(the only crash was trying to play the Niagara advanced portion, but that is most likely due to my GPU not being strong enough to handle all of it at once)

juliosueiras commented 2 years ago

the draft PR is here if anybody want to try it out(need to add the wrapper and thats it), keep in mind the result size is around 122GB(as usual for Unreal Engine)

dyaso commented 2 years ago

Trying to install 62eeb15105 keeps failing for me with error: Too many open files .

This is the end of the output: ``` /nix/store/zz53xrgqi4z0r2g9sgq5y9xhxdyvb61w-629161f1442cc070f84ca259e983259288e25a85.drv /nix/store/zz7k2dvk4dacixsgz899v4gsd93rdi0s-4b04e4b958292f22dda67f4b10168f4465a1e5da.drv /nix/store/zz9n51hqiysywrwmnvnl4ybjgki5mip5-f7a44be87cd8b2cc22a5c6580998902cd597ffac.drv /nix/store/xsah6clnmk6qkhgq4mgndbv9amrvhj9s-link-deps.sh.drv /nix/store/djqgp32g9nppwdlw1c65vq9qm8w9akas-ue5-unwrapped-5.0.1.drv /nix/store/7p3hypzpy1263fqwk3wp9sm8lldb8r4d-run-ue5.drv /nix/store/9l5jyhh2l365741h5m9q1gcf44vzvrzx-NVIDIA-Linux-x86_64-510.39.01.run.drv /nix/store/q2jw4zpp4zqxm6s65fpgs587vvkhpb07-nvidia-x11-510.39.01-5.15.34.drv /nix/store/b5szdf0zsrv6p2jsdxfhs95rfg8lhn47-UnrealEditor-usr-multi.drv /nix/store/dpnbwavz2a0gxr144lzwqxi0sy868fj3-UnrealEditor-init.drv /nix/store/lp5bvwgirryki7fl8an28b7x9pj5b4s9-ldconfig.drv /nix/store/m7mi8qrqpmkwr1j1c4lnhjd4drf3n3yx-profile.drv /nix/store/n9pfh8f189czc072dgnd9px7jigsy8hz-UnrealEditor-chrootenv-etc.drv /nix/store/gqfz9vfrcydhiaa393w6945bl27w5jmj-UnrealEditor-usr-target.drv /nix/store/m6v27rp04nwf2rnc5m94b2r4y27knf40-UnrealEditor-fhs.drv /nix/store/lzrsh8kg3pi79zzh31r73q660c2yk28y-UnrealEditor.drv /nix/store/bcn9i9rf31y36ynwlnmvnxsj72vcjr6d-UnrealEditor.drv building '/nix/store/jahqlpa0mrnxzp43drlb2qvgdzmlkw1d-builder.pl.drv'... building '/nix/store/lp5bvwgirryki7fl8an28b7x9pj5b4s9-ldconfig.drv'... building '/nix/store/m7mi8qrqpmkwr1j1c4lnhjd4drf3n3yx-profile.drv'... error: opening directory '/nix/store/pjwr9vhy4npycfgifhn5vx0xj24xwv7f-b4cc1896317297900c5e91fe25eb2f0c7a2cea8c': Too many open files ```

ulimit -n reports 1024, am going to try raising it using https://stackoverflow.com/questions/70473410/how-do-i-increase-the-limit-on-the-number-of-open-files-in-nixos

Edit: raising it to 65536 didn't help

... doing a system upgrade from 21.05 to 21.11 now

juliosueiras commented 2 years ago

@dyaso I think you might need to set the ulimit for nix-daemon itself, for ex. I have this for my machine systemd.services.nix-daemon.serviceConfig.LimitNOFILE = pkgs.lib.mkForce "40096"; , since is hardcoded by default to 4096

dyaso commented 2 years ago

That worked, thanks! Will try building again this evening. Huge gratitude for your work on this

juliosueiras commented 2 years ago

@dyaso fyi, the purpose of the wrapper is for tweaking and figuring out which packages is needed it for runtime, since for example, there are a few files path that need to be copied instead of symlink for Unreal to work(for building a game)

juliosueiras commented 2 years ago

but at the same time, this tweak won't cause rebuild for the base package, so no need to wait for 122GB rebuild

dyaso commented 2 years ago

I'm most interested in using the level and animation editors, and the in-editor python scripting (which doesn't run in the game engine, just automates tasks within the Editor itself). I don't need to build and package games separately, so long as the Play In Editor feature works (the play button on the top central toolbar). If you have the content examples working, that is everything I was hoping for.

Unfortunately, now I'm getting an error about not being able to download UnrealEngine-5.0.1-release.zip automatically, despite just downloading and adding it to the store as advised.

Tail of the installation output ``` $ nix-store --add-fixed sha256 downloads/UnrealEngine-5.0.1-release.zip /nix/store/asnk5fc2wv6br0qcasa0rbm6vf3biy0x-UnrealEngine-5.0.1-release.zip ``` Btw i'm trying to install the whole thing with `$ nix-env -f ue5nix/ -iA 'ue5'` , hope that's correct. ``` /nix/store/zz7k2dvk4dacixsgz899v4gsd93rdi0s-4b04e4b958292f22dda67f4b10168f4465a1e5da.drv /nix/store/zz9n51hqiysywrwmnvnl4ybjgki5mip5-f7a44be87cd8b2cc22a5c6580998902cd597ffac.drv /nix/store/xsah6clnmk6qkhgq4mgndbv9amrvhj9s-link-deps.sh.drv /nix/store/djqgp32g9nppwdlw1c65vq9qm8w9akas-ue5-unwrapped-5.0.1.drv /nix/store/7p3hypzpy1263fqwk3wp9sm8lldb8r4d-run-ue5.drv /nix/store/9l5jyhh2l365741h5m9q1gcf44vzvrzx-NVIDIA-Linux-x86_64-510.39.01.run.drv /nix/store/q2jw4zpp4zqxm6s65fpgs587vvkhpb07-nvidia-x11-510.39.01-5.15.34.drv /nix/store/b5szdf0zsrv6p2jsdxfhs95rfg8lhn47-UnrealEditor-usr-multi.drv /nix/store/dpnbwavz2a0gxr144lzwqxi0sy868fj3-UnrealEditor-init.drv /nix/store/gqfz9vfrcydhiaa393w6945bl27w5jmj-UnrealEditor-usr-target.drv /nix/store/m6v27rp04nwf2rnc5m94b2r4y27knf40-UnrealEditor-fhs.drv /nix/store/lzrsh8kg3pi79zzh31r73q660c2yk28y-UnrealEditor.drv /nix/store/bcn9i9rf31y36ynwlnmvnxsj72vcjr6d-UnrealEditor.drv building '/nix/store/lpa799dhcbj11gbgr7gjpp6ywwcsr2hr-UnrealEngine-5.0.1-release.zip.drv'... building '/nix/store/rdic62lf2fb07afhfp68gxpby06j51r5-06ff1948527143f9d1793ee543d2dcfb747a855f.drv'... building '/nix/store/bf14nnfk7n7mhpwglj1bbxl7gpvz02f1-070808461825eec7222431e9b3ea81fb7e43b80e.drv'... building '/nix/store/6z36i4cgqg6rk3nkiy34jyhs8rpbx07s-089f18ba43366ca33d2d15e83d1858473d9c2d61.drv'... *** Unfortunately, we cannot download file UnrealEngine-5.0.1-release.zip automatically. Please go to https://github.com/EpicGames/UnrealEngine/releases/tag/5.0.1-release to download it yourself, and add it to the Nix store using either nix-store --add-fixed sha256 UnrealEngine-5.0.1-release.zip or nix-prefetch-url --type sha256 file:///path/to/UnrealEngine-5.0.1-release.zip *** error: builder for '/nix/store/lpa799dhcbj11gbgr7gjpp6ywwcsr2hr-UnrealEngine-5.0.1-release.zip.drv' failed with exit code 1; last 10 log lines: > *** > Unfortunately, we cannot download file UnrealEngine-5.0.1-release.zip automatically. > Please go to https://github.com/EpicGames/UnrealEngine/releases/tag/5.0.1-release to download it yourself, and add it to the Nix store > using either > nix-store --add-fixed sha256 UnrealEngine-5.0.1-release.zip > or > nix-prefetch-url --type sha256 file:///path/to/UnrealEngine-5.0.1-release.zip > > *** > For full logs, run 'nix log /nix/store/lpa799dhcbj11gbgr7gjpp6ywwcsr2hr-UnrealEngine-5.0.1-release.zip.drv'. error: 1 dependencies of derivation '/nix/store/djqgp32g9nppwdlw1c65vq9qm8w9akas-ue5-unwrapped-5.0.1.drv' failed to build building '/nix/store/9l5jyhh2l365741h5m9q1gcf44vzvrzx-NVIDIA-Linux-x86_64-510.39.01.run.drv'... error: 1 dependencies of derivation '/nix/store/7p3hypzpy1263fqwk3wp9sm8lldb8r4d-run-ue5.drv' failed to build error: 1 dependencies of derivation '/nix/store/dpnbwavz2a0gxr144lzwqxi0sy868fj3-UnrealEditor-init.drv' failed to build error: 1 dependencies of derivation '/nix/store/lzrsh8kg3pi79zzh31r73q660c2yk28y-UnrealEditor.drv' failed to build error: 1 dependencies of derivation '/nix/store/bcn9i9rf31y36ynwlnmvnxsj72vcjr6d-UnrealEditor.drv' failed to build ```
juliosueiras commented 2 years ago

@dyaso what is the sha256sum of the zip?

juliosueiras commented 2 years ago

my zip is 09545b0cf2c435e27838f806ad9e0f3e7d7e48f744816c1e99b4a4ed10a659ec

dyaso commented 2 years ago

@juliosueiras 1c296e6f3f8d1eff960053b23ce95e115645c2d899a8c3f7810813d91f135e18 all three times i've downloaded it today, once on a different machine

Edit: i found a page saying that nix hashes should be 52 chars long, computed using nix-hash --flat --base32 --type sha256 UnrealEngine-5.0.1-release.zip, which gives me the value 062y2cgxj4q8h7vw7a4rv314amhibvlkrcjk02bgy7ld7xpnwa8w. I put that value in pkgs/games/ue5/unwrapped.nix line 43 and now the installation process seems to be proceeding, back to downloading things from Unreal CDN

juliosueiras commented 2 years ago

@dyaso thanks, found the issue, is due to the method of download from my end(the inside name of the zip is using hash instead of the tag which cause the sha256 to be different), will push the correct hash in a bit

dyaso commented 2 years ago

So close!

First build attempt, starting with ~182 GB free, took between 9-11 hours downloading and compiling before getting an out-of-space error and 124 GB free -- presumably it deletes partial compilation results unless the whole thing's successful?

Cleared another ~25 GB, tried again; at one point saw it sitting still with the message "buildPhase completed in 5 hours 13 minutes 22 seconds" and 24 GB free, came back an hour later to same disk space error, attached below. Again, 124GB are now free.

It talks at the top about an Android physics library -- as an example, is there any way to disable that component? I don't need to package things, just to use the Editor.

Is there a way to avoid the 5 hours rebuild time each attempt, if only the installation step is failing? Or maybe i could run it from where it's built, without adding it to the store?

Otherwise, now attempting to clear a further 100 GB...

Final 124 lines of build output, from where the errors start appearing ``` [287/290] Link (lld) UnrealInsights [288/290] Link (lld) libUnrealInsights-GameplayInsights.so [289/290] WriteMetadata UnrealInsights.version [290/290] WriteMetadata UnrealInsights.target Total time in Parallel executor: 778.88 seconds Total execution time: 782.26 seconds buildPhase completed in 5 hours 13 minutes 22 seconds installing mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3ExtensionsPROFILE.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3ExtensionsPROFILE.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPxPvdSDKCHECKED.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPxPvdSDKCHECKED.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CharacterKinematicCHECKED.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CharacterKinematicCHECKED.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CharacterKinematicPROFILE.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CharacterKinematicPROFILE.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CharacterKinematic.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CharacterKinematic.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3VehiclePROFILE.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3VehiclePROFILE.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPsFastXml.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPsFastXml.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPsFastXmlCHECKED.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPsFastXmlCHECKED.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPsFastXmlPROFILE.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPsFastXmlPROFILE.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3ExtensionsCHECKED.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3ExtensionsCHECKED.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CookingCHECKED.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CookingCHECKED.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3VehicleCHECKED.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3VehicleCHECKED.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPxFoundationPROFILE.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPxFoundationPROFILE.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3Cooking.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3Cooking.a': No space left on device mv: error copying 'Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CHECKED.a' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x64/libPhysX3CHECKED.a': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/x86': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Android/ARM64': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Mac': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/HoloLens': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/TVOS': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Win64': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/IOS': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/PhysX3/Lib/Unix': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Protobuf': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Python3': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Qualcomm': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Re2': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/RenderDoc': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/SDL2': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/SPIRV-Reflect': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/ShaderConductor': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/SpeedTree': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Steamworks': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Tencent': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Unix': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/VHACD': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Vorbis': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Vulkan': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/WebRTC': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/WiX': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/WinHttp': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/Windows': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/WindowsMixedRealityInterop': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/asio': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/coremod': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/dlmalloc': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/fastJSON': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/glslang': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/heapprofd': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/hlslcc': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/jemalloc': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libJPG': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libOpus': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libPNG': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libPhonon': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libSampleRate': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libWebSockets': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libcurl': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libjpeg-turbo': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libstrophe': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/libxml2': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/llvm': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/metis': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/mimalloc': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/mtlpp': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/nanosvg': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/nvTextureTools': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/nvTriStrip': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/nvtesslib': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/openexr': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/portmidi': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/rpclib': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/vcpkg': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/xxhash': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/zlib': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/ThirdParty/HoloLens': No space left on device mv: error copying 'Engine/Source/UnrealClient.Target.cs' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/UnrealClient.Target.cs': No space left on device mv: error copying 'Engine/Source/UnrealEditor.Target.cs' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/UnrealEditor.Target.cs': No space left on device mv: error copying 'Engine/Source/UnrealGame.Target.cs' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/UnrealGame.Target.cs': No space left on device mv: error copying 'Engine/Source/UnrealServer.Target.cs' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Source/UnrealServer.Target.cs': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Content': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Saved': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Engine/Intermediate': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/FeaturePacks': No space left on device mv: error copying 'GenerateProjectFiles.bat' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/GenerateProjectFiles.bat': No space left on device mv: error copying 'GenerateProjectFiles.command' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/GenerateProjectFiles.command': No space left on device mv: error copying 'GenerateProjectFiles.sh' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/GenerateProjectFiles.sh': No space left on device mv: error copying 'LICENSE.md' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/LICENSE.md': No space left on device mv: error copying 'Makefile' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Makefile': No space left on device mv: error copying 'README.md' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/README.md': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Samples': No space left on device mv: error copying 'Setup.bat' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Setup.bat': No space left on device mv: error copying 'Setup.command' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Setup.command': No space left on device mv: error copying 'Setup.sh' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Setup.sh': No space left on device mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Templates': No space left on device mv: error copying 'UE5.code-workspace' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/UE5.code-workspace': No space left on device mv: error copying 'cpp.hint' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/cpp.hint': No space left on device error: builder for '/nix/store/sj81r8ivbs5yh5nnm027gbd9sdrrxlmm-ue5-unwrapped-5.0.1.drv' failed with exit code 1; last 10 log lines: > mv: error copying 'LICENSE.md' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/LICENSE.md': No space left on device > mv: error copying 'Makefile' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Makefile': No space left on device > mv: error copying 'README.md' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/README.md': No space left on device > mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Samples': No space left on device > mv: error copying 'Setup.bat' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Setup.bat': No space left on device > mv: error copying 'Setup.command' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Setup.command': No space left on device > mv: error copying 'Setup.sh' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Setup.sh': No space left on device > mv: cannot create directory '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/Templates': No space left on device > mv: error copying 'UE5.code-workspace' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/UE5.code-workspace': No space left on device > mv: error copying 'cpp.hint' to '/nix/store/hswpj3ll7w5if3xmrzmci6cbw2185vri-ue5-unwrapped-5.0.1/cpp.hint': No space left on device For full logs, run 'nix log /nix/store/sj81r8ivbs5yh5nnm027gbd9sdrrxlmm-ue5-unwrapped-5.0.1.drv'. note: build failure may have been caused by lack of free disk space error: 1 dependencies of derivation '/nix/store/0cxlrwsiz80r6bq6dm9wsh1h40qih9zd-run-ue5.drv' failed to build error: 1 dependencies of derivation '/nix/store/w6ihbnh5r2pb7p35b00k0kk5rkm58m2h-UnrealEditor-init.drv' failed to build error: 1 dependencies of derivation '/nix/store/kl2h16mmcjsagzj3c7s78nv2nbj5a4x2-UnrealEditor.drv' failed to build error: 1 dependencies of derivation '/nix/store/6nw0s2jhk168jcl7qqap99hxd1v5a50h-UnrealEditor.drv' failed to build ```
juliosueiras commented 2 years ago

as of right now not sure(since I am adapting from what ue4 pkg had)

juliosueiras commented 2 years ago

try with 150/160 GB free space if you can

dyaso commented 2 years ago

175 GB free, am going to try nix-build ue5nix/ -A 'ue5' first, hopefully that'll produce a results symlink i can run without installing but which won't require more rebuilds from scratch? Sorry, my nix knowledge is really poor; i started reading the pills, but then resorted to booting into Windows to run things like UE and have forgotten most of it

juliosueiras commented 2 years ago

that would be correct A) remember is still a draft PR so additional fixes may require B) but the fixes would only be done to the wrapper level, so it won't require additional rebuild for the UE5 itself

dyaso commented 2 years ago

Earlier it was sitting there with the "buildPhase completed" message again, free space was 9.5GB, now "fixupPhase completed in 9 minutes 59 seconds" and 127 GB are free.

Editor is starting atm, compiling thousands of shaders.

... Then crashed during startup at 83% with the following:

Assertion failed: EnumHasAnyFlags(UEFlags, ETextureCreateFlags::UAV) [File:./Runtime/VulkanRHI/Private/VulkanTexture.cpp] [Line: 446] ``` LogSubsystemCollection: Failed to initialize subsystem dependency (WorldPartitionSubsystem) Signal 11 caught. Malloc Size=262146 LargeMemoryPoolOffset=262162 CommonUnixCrashHandler: Signal=11 [2022.05.05-01.22.01:603][ 0]LogCore: === Critical error: === Unhandled Exception: SIGSEGV: invalid attempt to write memory at address 0x0000000000000003 Assertion failed: EnumHasAnyFlags(UEFlags, ETextureCreateFlags::UAV) [File:./Runtime/VulkanRHI/Private/VulkanTexture.cpp] [Line: 446] libUnrealEditor-VulkanRHI.so!FVulkanSurface::GenerateImageCreateInfo(FVulkanSurface::FImageCreateInfo&, FVulkanDevice&, VkImageViewType, EPixelFormat, unsigned int, unsigned int, unsigned int, unsigned int, unsigned int, unsigned int, ETextureCreateFlags, VkFormat*, VkFormat*, bool) [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/VulkanRHI/Private/VulkanTexture.cpp:446] libUnrealEditor-VulkanRHI.so!FindOrCalculateTexturePlatformSize(FVulkanDevice*, VkImageViewType, unsigned int, unsigned int, unsigned int, unsigned int, unsigned char, unsigned int, unsigned int, ETextureCreateFlags) [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/VulkanRHI/Private/VulkanTexture.cpp:2574] libUnrealEditor-VulkanRHI.so!FVulkanDynamicRHI::RHICalcTexture2DPlatformSize(unsigned int, unsigned int, unsigned char, unsigned int, unsigned int, ETextureCreateFlags, FRHIResourceCreateInfo const&, unsigned int&) [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/VulkanRHI/Private/VulkanTexture.cpp:2594] libUnrealEditor-Engine.so!FTexture2DResource::GetPlatformMipsSize(unsigned int) const [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/Engine/Private/Rendering/Texture2DResource.cpp:186] libUnrealEditor-Engine.so!FStreamableTextureResource::InitRHI() [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/Engine/Private/Rendering/StreamableTextureResource.cpp:169] libUnrealEditor-RenderCore.so!FRenderResource::InitResource() [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/RenderCore/Private/RenderResource.cpp:120] libUnrealEditor-RenderCore.so!TEnqueueUniqueRenderCommandType::DoTask(ENamedThreads::Type, TRefCountPtr const&) [/build/UnrealEngine-5.0.1-release/Engine/Source/Runtime/RenderCore/Public/RenderingThread.h:193] libUnrealEditor-RenderCore.so!TGraphTask >::ExecuteTask(TArray >&, ENamedThreads::Type, bool) [/build/UnrealEngine-5.0.1-release/Engine/Source/Runtime/Core/Public/Async/TaskGraphInterfaces.h:975] libUnrealEditor-Core.so!FNamedTaskThread::ProcessTasksNamedThread(int, bool) [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/Core/Private/Async/TaskGraph.cpp:753] libUnrealEditor-Core.so!FNamedTaskThread::ProcessTasksUntilQuit(int) [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/Core/Private/Async/TaskGraph.cpp:641] libUnrealEditor-Core.so!FTaskGraphCompatibilityImplementation::ProcessThreadUntilRequestReturn(ENamedThreads::Type) [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/Core/Private/Async/TaskGraph.cpp:2114] libUnrealEditor-RenderCore.so!RenderingThreadMain(FEvent*) [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/RenderCore/Private/RenderingThread.cpp:380] libUnrealEditor-RenderCore.so!FRenderingThread::Run() [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/RenderCore/Private/RenderingThread.cpp:544] libUnrealEditor-Core.so!FRunnableThreadPThread::Run() [/build/UnrealEngine-5.0.1-release/Engine/Source/./Runtime/Core/Private/HAL/PThreadRunnableThread.cpp:25] libUnrealEditor-Core.so!FRunnableThreadPThread::_ThreadProc(void*) [/build/UnrealEngine-5.0.1-release/Engine/Source/Runtime/Core/Private/HAL/PThreadRunnableThread.h:185] libc.so.6!UnknownFunction(0x89eb1) libc.so.6!UnknownFunction(0x10c31b) ```