runtimejs / runtime

[not maintained] Lightweight JavaScript library operating system for the cloud
http://runtimejs.org
Apache License 2.0
1.93k stars 127 forks source link

Using WebAssembly? #111

Open facekapow opened 8 years ago

facekapow commented 8 years ago

V8 has support for WebAssembly, and supposedly has near-native speeds. Could we make use of this in runtime? Also, Wasm is hidden behind a flag, so is there any way to enable flags for V8 in runtime?

iefserge commented 8 years ago

Yes, we should be able to enable Wasm, I'm going to update V8 to the latest version and see if Wasm works. With Wasm runtime.js will no longer be limited to JavaScript, and things like crypto (libsodium) can be loaded as Wasm modules instead.

piranna commented 8 years ago

Yes, we should be able to enable Wasm, I'm going to update V8 to the latest version and see if Wasm works. With Wasm runtime.js will no longer be limited to JavaScript, and things like crypto (libsodium) can be loaded as Wasm modules instead.

That would be cool! :-D

RossComputerGuy commented 8 years ago

That would be cool for BasicOS. Update on BasicOS: new homepage and I had to restart the project. There was too many errors.

iefserge commented 7 years ago

Got WebAssembly working using updated V8 (it still needs --expose-wasm which is disabled by default).

I'm trying to figure out a nice way to pass V8 flags. I'm thinking maybe read flags from v8.flags file in the root directory of the project. This will make it easy for each project to specify v8 flags it needs.

Wasm example looks like this

const fs = require('fs');
const buf = fs.readFileSync('add.wasm');

const addModule = Wasm.instantiateModule(buf);
console.log('wasm binary: add(1, 2) =', addModule.exports.add(1, 2));

asm.js -> wasm works too

function AsmModule() {
  'use asm';

  function add(a, b) {
    a = a | 0;
    b = b | 0;
    return (a + b) | 0;
  }

  return {add};
}

const addModuleFromAsm = Wasm.instantiateModuleFromAsm(AsmModule.toString());
console.log('wasm from asm: add(1, 2) =', addModuleFromAsm.add(1, 2));
facekapow commented 7 years ago

@iefserge Nice, I've got a little system built to test out runtime.js features and I've included a kernel with the flags enabled. One thing I've noticed is that emscripten-compiled WebAssembly takes a bit to load code with C headers, but at least twice as long to load C++ headers.

I like the idea of having custom flags in each project, but I wonder how this would be implemented? If they're set by the library after V8 is started, then it's dangerous. One way it could be done safely is for runtime-cli to read it from the package.json and embed it into the initrd header, then the kernel could read them and set them before initializing V8.

iefserge commented 7 years ago

@facekapow it would read file from initrd once during the startup. Shouldn't be an issue since initrd code is C++. package.json solution is interesting too, but yeah it requires updating initrd format. How would this config look like in package.json? I see you patched runtime to enable wasm, pretty cool :)

Edit: Actually runtime-cli can include any metadata as special files, so no initrd format updates are necessary.

facekapow commented 7 years ago

I think it'd be something like:

{
  "name": "my-pkg",
  "version": "1.0.0",
  "v8": {
    "flags": "--expose_wasm --harmony_async_await --other_flags"
  }
}

How does including metadata work? I quickly skimmed over the code to pack an initrd and to read it from the kernel and didn't see anything. Would it just be included as a regular file and read by the kernel?

Also, we could just parse the root package.json in the kernel using this little C++ JSON parser (or this other parser, focused on memory limited systems) and fetch the flags like that.

iefserge commented 7 years ago

There is a file type id, can use another id to include any metadata. https://github.com/runtimejs/runtime/blob/master/src/kernel/initrd.cc#L96

Anyway, you're right it might be easier to just parse JSON in C++, since we may have runtime.js flags there too at some point. Makes sense to group those?

{
  "runtime": {
    "enableProfiler": true,
    "enableWebWrokers": true,
    "v8flags": "--expose_wasm"
  }
}
facekapow commented 7 years ago

If we go the JSON route, in order to allow the field to be an object, runtime-module-loader would have to modified at line 129 and add something like:

  // ...
} else if (typeof parsed.runtime === 'object' && typeof parsed.runtime.main === 'string') {
  return parsed.runtime.main;
} else {
 // ...

And the corresponding code would need to be modified in js/__loader.js, but... it would have to wait until #120 merges (or doesn't), because again, would want to avoid any future merge conflicts.

Edit: and yes it makes sense group the options.

iefserge commented 7 years ago

Yeah sure, let's merge #120 first.

kumavis commented 7 years ago

i hunger for webassembly unikernels!

yshemesh commented 6 years ago

What is the state of using WASM in runtime.js? and why there is no place for an independent unikernel (not runtime.js) that only runs WASM?

piranna commented 6 years ago

What is the state of using WASM in runtime.js? and why there is no place for an independent unikernel (not runtime.js) that only runs WASM?

It could be feasable, there's already wasm VMs written in plain C, so it would be plainly trivial (but without a JIT compiler, fairly slow). There has been similar approachs in the past, for example Inferno OS with the dis assembler specification.

RossComputerGuy commented 6 years ago

Can a WebAssembly vm work?

piranna commented 6 years ago

Can a WebAssembly vm work?

It depends what do you want to achieve with it...

RossComputerGuy commented 6 years ago

If I were wanting to use it for adding numbers, it would work.

piranna commented 6 years ago

What do you mean by "adding numbers"?

RossComputerGuy commented 6 years ago

Just some WebAssembly tests and examples