search

lemanschik / web-modules

A Web Module Loader can also be used in WInterCG Standard Supporting Runtimes
The Unlicense
0 stars 1 forks source link

Tracking: ECOSYSTEM Adoption: V8 Is now a „General Recursive Applicative and Algorithmic Language“. Virtual Machine and so is the web! #4

Closed lemanschik closed 1 year ago

lemanschik commented 1 year ago

Roadmap

  1. @component-manager/create creates in a folder i private name it cloud a basic skeletton
  2. @component-manager/node gets installed by create directly as if you use the skel with npm your node user. 2.1. is then /cloud/device/node
  3. @component-manager/chromium can get installed via node installs 4.1. /cloud/device/chromium 4.2. /cloud/device/node/node_modules/@component-manager/chromium

you can expect out of the pattern that @component-manger indicates that it is linked to a /cloud/device with the same name.

Explainer

we align the build systems into a single web-module standard compose able web scale hashed content addressed shared build grid this tracks the overall compat and adoption process as soon as something is closed here you can build it in the browser or other web platform without servers a self building web 4.0 based on Security Zero Trust Capability based auditable protocols and blockchain git commit versioning principles

the best out of Operating Systems file system and package management research of over 20 years. Auditing every Package manager and distro as also compilers and linkers in general.

You will get forced into this patterns anyway as they are simply the best that we have this allows you early adoption at present the first project where we land this will be code-oss so vscode it self the Authoring Environment. This allows us to nudge and take over everything else out of the existing ecosystems fast.

Copyed from readme as reference

web-modules is a protocol:

web-modules Has directories and files as also devices and modules

web-modules Can be used to view documents like the conventional web

web-modules Connection layer over any network protocol

web-modules uses crypto:

web-modules Worldwide peer-to-peer file transfers

web-modules is a CDN:

web-modules is a name service:

Track Node Packages

Track GraalVM

Track LLVM

Track Meson

Track Nasa ASM

Track cmake

Track gcc

Track Microsoft internal packaging formats like cab.

Track GN + Ninja

Track Python usage deprecation migration progress.

milahu commented 1 year ago

world wide web scale shared p2p distributed content addressed module build cache

grandiose ...

sounds like nix + IPFS https://github.com/NixOS/nix/issues/859 but nix does not-yet work in javascript, see also https://github.com/milahu/nix-eval-js

declarative DSL ...

see also:

i would need "something like this" for a self-hosted web-desktop. "self-hosted" as in: i can use the web-desktop to modify the web-desktop. similar to nixos, where i run sudo nixos-rebuild switch to build a new "generation" of my system, and where i can rollback to previous generations if something goes wrong

one problem with a "pure" system like nix: when i want to patch a dependency somewhere in the middle of the dep-graph, then i must rebuild that dependency and all "dirty" packages. ... because /nix/store is read-only. workaround: https://discourse.nixos.org/t/writable-nix-store/18964

web-desktop

example: https://github.com/os-js example app: https://github.com/os-js/osjs-xterm-application metadata: https://github.com/os-js/osjs-xterm-application/blob/master/metadata.json ... but they use npm, so its not content-addressed

based on Security Zero Trust Capability based auditable protocols and blockchain git commit versioning principles

you still need "someone" (package maintainers) to audit source code for security, because autoupdate is remote code execution

content-addressed device or system

one problem of CAS is that you cannot have self-references or circular dependencies. nix packages are "input-addressed" by default, because thats easier to implement

lemanschik commented 1 year ago

Good input overall great that you understand the concepts and ideas i solved all above mentioned issues and yes it is inspired by the same concepts as *nix but this is declarativ in any other way also.

It is much to much to write about it this is simply reaching out for help and awareness while i already started implementing the final poc of what you propose at

see:

lemanschik commented 1 year ago

code-oss or vscode gets a Operating System that builds it self.

lemanschik commented 1 year ago

the content addressing comes via the vscode internal build system which uses compiler integration for source hashing and so on.

lemanschik commented 1 year ago

@hayatoito does that align with your web bundels vision my web modules MVP is in fact similar but it has not the issues and only the pro parts as this needs no bundling and has stuff like block depduplication and so on this is mainly a WebRTC based Goma https://chromium.googlesource.com/infra/goma/server/ Like Build tool that can directly execute distributed code and apps.

please give input and also look into:

and whatch the demo browser:

as also note that i have all that local tested i only backport it this is not a Question if this can be done i have done it i only document it now and could need help to integrate all over the web and spread the knowleg.

milahu commented 1 year ago

talk is cheap ...

https://github.com/beakerbrowser/beaker

last commit 2 years ago

this is mainly a WebRTC based Goma Like Build tool that can directly execute distributed code and apps.

security...? who will audit all that code? sandboxing is no silver bullet

I write the build tools and compilers that other should use while they do not do so. I also author books that no one did read or will read. I do it so that when i am dead i can look back and say i knowed it better. -- https://github.com/lemanschik?tab=overview

same ^^ but "the world" does not care. i hope you know the terms "vaporware" and "academic problem" ...

so ... effectively, you want to replace central services (npm, github, cloud CI) with "something p2p". ideally p2p, realistically a federation of servers (gitea ...)

see also https://radicle.xyz/ - a p2p git client

see also https://github.com/denoland/deno - fetches import urls to a local CAS

see also https://www.google.com/search?q=p2p+package+manager+ipfs

questions

lemanschik commented 1 year ago

@milahu read the fuchsia os docs i guess will give you the first good documentation after you understood that in general think about a simplyfied version of all that useable via ECMAScript.

about why does this not exist because no money is inherented while dev? i did invest over 20 years alone more or less?

attacks are handled like on any other network blocking the access.

the performance is the best ever seen in history of computing even on a single instance:

the rank 1 which is called just is a coding pattern experiment it is just v8

so the ECMAScript engine i am my self v8 and chromium engineer. Also OS Engineer (Fuchsia Zircon kernel) also VM researcher GraalVM

i am maybe one of the persons who simply invested most of his whole life with research and engineering of fundamentals that's why i can come up with that and pull that off. I did not invest my Work time into that also my Free time full time over 20 years after i was 10 years already into reverse engineering and cracking hardware dongles like the one from cubase.

this is not the result of motivation its the result of dedication! I think about that when i wake up and i go sleep when i have no energy anymore to work on that. Loop

img img

this is not a temp project:!

it has not the dev weakness as it is not coded and maintained like the linux one in fact when the kernel part goes live i expect Linux to switch over he will do so only to get ride of rust we will see also i expect stuff like systemd will switch i did prepare execution plans and migration strategies already for that also projects like Mesa i guess there is not a single tech guy who does not want to finally code against a web scale sized super pc this is what the web wanted to be since ages or i am wrong ? This is Integrity checked ECC Like Persistent in Memory RAM including the ultimate BUS we can call it VROOM so VROOM VROOM like a engine

IPFS abstracted a filesystem i abstracted a HYPERVISOR and HYPERVISOR Monitor so VM and VMM in linux talk

i am such deep into that that i know for example that the german red hat page about that topic watch the first lines of the article states VMM would be VVM there is a typo!

so please do not question me like that i do not deserve that punishment only because i want to publish it!

I am a single person always when i reach out for help no one helped me so no need to question now the results or the progress speed on it! In fact that it not existed before simply shows that no one did care as much as me about it to exist.

let me quote elon on that

Let the Web sink in

@milahu if you would want to join the project i would be more then happy! I am also german i do not care for your existing knowleg about anything. You can not put more water into a glass that is already full so we will empty most out of your head anyway but i need people who care for the whole.

my mental illness forced me to not accept workarounds so i corrected the fundamentals its that easy.

as i also innovated on distributed database i soon found out that treating things like Objects is better then treating it like files that we translate to objects. and code is a Object and ECMAScript a Object based Language based on UTF8 and JSON so all alignment is given right? Do you understand that highlevel part? In that sentence we can replace file with 0 so null nothing and still got a working Application or lets even call it Operating System as soon as we implement a REPL so reqest eval print loop thats what a shell is as you know.

the part the mystical genesis boot of web 4.0 is simply deploying the Ethernet v2 protocol layers to enough routers that are connected via any abstract connection. At that point we created VLAN based on Ethernet v2 but also created a total new kind of hardware target i could endless expand the context i guess it is more easy to focus on the higher level knowleg as the fundamentals existed all the time we only need to execute. this is the virtio like stuff in kubernets on the kernel level while our kernel is the internet it self the web. a FPGA Programmable Mega CPU with web scale cores that also can get sharded into single super core units taking a single cpu clocking cycle.

About the question where is the code?

It is deployed your running it while you read this only the software to use it does not exist. All API's all is there. We only need some conventions which i plan to obtain while executing as everything is a component out of modules we can always restructure this is by design never braking any existing stuff API or its own API.

milahu commented 1 year ago

i am maybe one of the persons who simply invested most of his whole life with research and engineering of fundamentals that's why i can come up with that and pull that off.

stop talking, just do it

it has not the dev weakness as it is not coded and maintained like the linux one in fact when the kernel part goes live i expect Linux to switch over he will do so only to get ride of rust we will see also i expect stuff like systemd will switch i did prepare execution plans and migration strategies already for that also projects like Mesa i guess there is not a single tech guy who does not want to finally code against a web scale sized super pc this is what the web wanted to be since ages or i am wrong ?

not wrong but naive

so please do not question me like that i do not deserve that punishment only because i want to publish it!

stop talking, just do it

In fact that it not existed before simply shows that no one did care as much as me about it to exist.

no, there are other reasons

let me quote elon on that

Let the Web sink in

so youre an elon fanboy? haha

i need people who care for the whole.

my mental illness forced me to not accept workarounds so i corrected the fundamentals its that easy.

at least you admit youre crazy

as i also innovated on distributed database i soon found out that treating things like Objects is better then treating it like files

graph database

simply deploying the Ethernet v2 protocol layers to enough routers that are connected via any abstract connection. At that point we created VLAN based on Ethernet v2 but also created a total new kind of hardware target

the inventor of the word "simple" would not agree

i could endless expand the context i guess it is more easy to focus on the higher level knowleg as the fundamentals existed all the time we only need to execute.

well then ... go forth and execute

this is the virtio like stuff in kubernets on the kernel level while our kernel is the internet it self the web. a FPGA Programmable Mega CPU with web scale cores that also can get sharded into single super core units taking a single cpu clocking cycle.

awesome. will it take us to mars?

where is the code?

It is deployed your running it while you read this only the software to use it does not exist. All API's all is there.

right, the code exists in your head. writing, testing, running, distributing, features, bugfixes ... thats trivial : D

stop talking, just do it

lemanschik commented 1 year ago

@milahu here nodejs fanboy take that and wrap your head around that.

tennox commented 1 year ago

Hi @lemanschik, I stumbled over your web of issues and wanna give some feedback:

First, I love the idea(s) to rework the broken internet from the ground up, and many people (like me) have many similar ideas - albeit way less sophisticated and researched). So chapeau for that, definitely. Great that you delve into the details and work on plans and documentation.

I must say I don't get most of what you're writing, which I think is partly because your english is not so good, in part because many things you're talking about are way over my head, and in part also because it feels you try to put many different thoughts in each sentence. I think for brain-dumping this works, but for trying to get people to understand and join it does not. :tipping_hand_man:

Also, I want to tell you that while I clearly see you got a lot of knowledge across the board, I think as you're still a single human being, and given the complexity of your plans:

  1. Be aware that this will most likely not all be realisable even within a few years, if you don't manage to inspire a team and actually the whole community to work on this, and for this you need to prepare for many difficulties.
  2. consider being a bit more realistic in that sense also when communicating with other projects - for example saying "this issue is closed by" in the Nix IPFS issue is a bit far off as I don't think you have a workable and compatible solution that solves the issues and workloads this issue is addressing
  3. and this kind of humbleness goes a long way in not getting people annoyed or confused with your idea and putting you of as "crazy" or similar. Thus also helping with 1. (inspiring the community)

In the end I don't know can only assume what your intentions and readiness to even work with the community are, but I made my assumption based on that you're publicly sharing your ideas and linking to it all over the place.

And @milahu please refrain from disrespectful comments like:

stop talking, just do it

at least you admit youre crazy

This will not serve anyone and either try to bring feedback in a respectful way or leave it.

I'll curiously follow your endavours and wish you the best, also that you manage to not make yourself more alone than you need to be.

lemanschik commented 1 year ago

@tennox good tips overall but i guess the ristence is even driving me more and more far as i am forced to do it alone my patterns get better and better daily today i think i did solve the most complex naming issues and can now go into the rolling release cycle mode so linear track able progress via the github.com/component-manager org and the inherent @component-manager npm scope

i have plans to get first view able impressions at last fundamentals working in a document able shape

i simplified it all i take existing software as device

so /dev/node then you can think about it more easy as dev/node can be anywhere it was hard for me to set the right mindset and terminologie for that

but i guess i solved it everything is a component or device composed out of modules that do link memory into a application the memory does not unload till all Network Wide instances get closed.

what do you think?

I Market it as google cloud clone that runs in the browser or anywhere else. So offering the full stack of cloud services

that openstack aws and google cloud offer but in the browser so every one gets hist own Internet Provider Including cloud provider. Do you think the people will understand?

lemanschik commented 1 year ago

i invented today working patterns to compose software in a way that it runs nativ and on the web and even nativ on the web so it is only a question of definition. as the smallest denominator i have the import export api design including the fetch spec of ECMAScript

that is the only fundamental part the rest is script able. I simply put versioning and package management into a module like yarn pnp does or the pnp standard even it self is well to kick off

so ECMAScript Modules + pnp + alittle bit of codebased served via http or webrtc are enough to be a fully functiinal production ready fundation

lemanschik commented 1 year ago

It is nix written in ECMAScript following same principles.

lemanschik commented 1 year ago

@tennox the good thing about the stuff i am executing now is that it is researched since ages i just recombine in a usefull way with the learnings of the past here something out of our research this is what electron should and will be:

look into that it is only a example repo but fully working in general the parts if there are any that not work are already documented in the puppeteer docs.

i am not fully alone i am backed in fact by the best engineers of the whole world! but they simply have no space for additional efforts some one needs to execute the overall ecosystem education and simply execute i am now dedicated to only the execution it was no joke all exist all is tested all is best out of all.

i invested also into communication with all upstream related people of the whole linux world and all projects that are related

this now gets communicated only to projects that depend on us already anyway!!!!!!

There is no single part that is not solved ecosystem wide we execute now the Replacement of Linux with ECMAScript complet and free ECMAScript from any OS.

as sayed see: https://github.com/lemanschik/carlo

and if you need years of benchmarks with that tech:

https://www.techempower.com/benchmarks/#section=data-r21&test=composite

we run even a complet benchmark and test suite since ages place 1 is what gets executed and called JUST!!!!

the java ecosystem swallowing and interop is called ES4X search it in the list

this both so just + es4x = Linux + Java complet stacks no kernel needed.

we even had linux forks

i have fully shared v8 builds between all ecosystem parts even Java and graalvm

so we have all npm packages running on java and nativ c

The ECMAScript Engine supports Polyglot now all languages that exist and will exist we turned ECMAScript into a Interface definition language

V8 Is now a „General Recursive Applicative and Algorithmic Language“. Virtual Machine and so is the web!

as graal is licensed by Oracle i need to come up with something like Stealify Lang: a Recursive Applicative and Algorithmic Language to programmatically create VM'S so i created a SuperSet of Typescript and and ECMAScript joined it into Stealify Lang to have something to Market to Abstract the word ECMAScript HOST ESHost while still compatible and valid. Needed a Replacement i have choosen B8G Which is slang for Big Engine which is a abstracted ECMASCript written in ECMAScript via simple making some API Alignments.

overall the development iterations where i planned to roll some stuff out was frustrating and error purne as the project size is large and i am alone i needed to invent systems and patterns to manage a Whole Cloud OS Stack alone.

while i could local always fast make links and all that i needed patterns and methods that are useable by others at any scale without frustration.

The final concept is now @component-manager which i have taken from Fuchsia OS research again even researched that it can replace android without frustration done via World wide google Nest HUb Deployment Experiment that was are large success in fact it worked as expected.

in fact i did the missing project management parts which no one was aware of i did it by dedication. And Collected all the tracking and joining of a World wide interop able component system.

I tracked them all and collected carefully and adopted where needed whats needed. to have a streamlined Ecosystem that works anywhere. based on the component composition patterns and some other stuff that helped me to manage a project of such a size and scale composed out of 3th party projects maintained in a ton of ways.

So this combines the best out of VM research with the best out of Package and Cloud management Research with the best out of coding patterns and coding team process Research.

all combined into the lowest possible effort to maintain while still be feature complete with all development styles workflows and so on.

Roadmap soon

Preparing now the libcontainer swallowing into the Engine

this is a historical moment where i try to align the most used Dev Tech today that is containers which in fact only produces a binary dump with the new VM abilities of v8

i repeat my self all is tested there is nothing new under the sun simply stopped maintenance as maintaining a old structure based on wrong fundamentals was not sufficient for a single person needed to progress.

milahu commented 1 year ago

there is nothing new under the sun

exactly

since 5 years we have stackblitz and turbo https://medium.com/stackblitz-blog/introducing-turbo-5x-faster-than-yarn-npm-and-runs-natively-in-browser-cc2c39715403

since 1.5 years we have webcontainers https://blog.stackblitz.com/posts/introducing-webcontainers/

lemanschik commented 1 year ago

@milahu i was not aware of that but that looks like a nice integration point thanks a lot for bring that up. But they did create a WASM vm this is about ECMAScript VM which also includes WASM we can in fact give multiple cpu instructions to WASM so emulate x86 and even complexer cpu types like newer RiscV processors.

update

it is not even a wasm vm it is a wasm build of nodejs a stripped down one which is a nice thing as i can turn that into modules.

lemanschik commented 1 year ago

@milahu i looked into the issues that they got i think i can sort them out and work with them together can you bring up stuff that blocks you? that you see missing. So i see more fast what to tackle first?

What is your most big pain point in your current dev flow.

lemanschik commented 1 year ago

@milahu lets see if they can handle the input https://discord.com/channels/364486390102097930/680953097354215446

milahu commented 1 year ago

But they did create a WASM vm this is about ECMAScript VM

you still have no idea what youre talking about ...

i can turn that into modules.

yeah? then shut up and JUST DO IT

What is your most big pain point in your current dev flow.

you. you ignore all advice, so people ignore you

dont feed the trolls

trolls-1304628002

lemanschik commented 1 year ago

@milahu you may want to silently follow https://github.com/unlicense-code/web-modules i will open source the stackblitz stack there but please do not troll there so much but i still want that your on track i like you. If that would not be the public internet i would talk a other slang to you hahahaa.

lemanschik commented 1 year ago

Closed in favor of writing the offical 3rd edition of Compilers Principlels and tooling the white dragon book

all who want to read the 2nd edition can find it here https://github.com/muthukumarse/books/blob/master/Dragon%20Book%20Compilers%20Principle%20Techniques%20and%20Tools%202nd%20Edtion.pdf