datacleaner / DataCleaner

The premier open source Data Quality solution
GNU Lesser General Public License v3.0
599 stars 181 forks source link

Run analysis job using the return of HTTP Request #488

Closed phelipemaia closed 9 years ago

phelipemaia commented 9 years ago

Is it possible to run an analyzer using the return of an URL? I have a REST service that retrieve a JSON object and I want to analyze this object. I was wondering if I need to create a new connector or if does exist an easier way to do that.

drexler42 commented 9 years ago

Hi. I don't think DC has a component that does this. But I suppose you can always use a JavaScript transformer to invoke the REST service and write the results to the output of that transformer. That way, you can do almost anything.

cheers,

Hans

phelipemaia commented 9 years ago

Hi @drexler42

I think it's a little more complicated. What I was trying to do is probably create a new Connector. This connector will be a RESTConnector (like Oracle, SugarCRM, SalesForce, etc) and I would run the analysis using the data retrieved by this REST request. So, I would create a config with username, password (basic auth), URL, and with these configs I would ran the analysis. Do you know what I mean?

cheers

phelipemaia commented 9 years ago

For those who wanna know about this discussion: http://datacleaner.org/topic/1081