NodeSecure / rfcs

💬 Exchange and discuss the future of NodeSecure (new ideas and projects etc).
MIT License
0 stars 0 forks source link

NodeSecure Database #3

Open fraxken opened 2 years ago

fraxken commented 2 years ago

The goal of this project would be a create our own databases that contain packument and manifest from NPM registry.

We could integrate our tools with this database to store data that would be relevant to us:

We can start this project by using a replicate of NPM

// Import Node.js Dependencies
import fs from "fs";

// Import Third-party Dependencies
import * as httpie from "@myunisoft/httpie";

// CONSTANTS
const kNpmReplicateDB = "https://replicate.npmjs.com/_all_docs?include_docs=true";

httpie.stream("GET", kNpmReplicateDB)(fs.createWriteStream("./npmdb.json"));

Then this database can be used for project like Preview (or for our own research).

Kawacrepe commented 2 years ago

We may want to add information about domains inside our database.

Since whois.iana looks like having a rate limit

fraxken commented 2 years ago

After discussion in the last meeting, we should clarify:

Actions to take to work on the subject:

@Rossb0b was interested to be the champion on this project.