search

dharmafly / noodle

A node server and module which allows for cross-domain page scraping on web documents with JSONP or POST.
https://noodle.dharmafly.com/
745 stars 69 forks source link

Is this project dead? #128

Open mike442144 opened 6 years ago

mike442144 commented 6 years ago

Is this project dead? It seems that it isn't maintained now.

premasagar commented 6 years ago

I think this project might be dead. Or waiting to be reborn. There are issues with some of the dependencies and would require a bit of a spring clean to bring it into life.

Noodle began as an exploration into having a union of intentional and unintentional APIs (i.e. every public web page and document), easily queried from a client, and extendable into modules of information. I think that's still relevant.

I mentioned some time back in the Issues that I was working on a codebase inspired by Noodle, which has been through a couple of evolution cycles, but not yet ready to be released.

It would be good to hear people's thoughts - is this useful, what are you use cases, and what would still be useful to achieve with such a tool?

mike442144 commented 6 years ago

Thanks, I recently find this project because I'm going to setup a server which receive scripts or something like json and do data scrapping inside the server. It has many differences from noodle, but I look noodle as a core API provider, more featured interface should be wrapped. I think if noodle is flexiable and extendable enough, I can develop based on it. I'd like to know if you have any plans or what are you waiting for ?

AaronAcerboni commented 6 years ago

Yo! I noticed I couldn't install this project's dependencies from a fresh windows / node install. I think it's something to do with a dependency (xml-to-json) requiring python to build itself when you run npm install.

I made a new branch which replaces xml2json with xml2json-light. Haven't really digested all of the implications of this but tests passing. Still plenty of cobwebs but now at least it builds (for me at least!). I'll leave it to @premasagar to see if its appropriate to merge the branch and update the project on npm in case I break something as I haven't coded in awhile.