search

datahub-project / datahub

The Metadata Platform for your Data Stack
https://datahubproject.io
Apache License 2.0
9.81k stars 2.89k forks source link

New ETL Job Post always returning 404 #211

Closed sunny1978 closed 8 years ago

sunny1978 commented 8 years ago

POST /etl/ HTTP/1.1 Host: localhost:9001 Content-Type: application/json Cache-Control: no-cache Postman-Token: 687fc192-7ceb-34f3-06a0-be1d7110e46b

{ "wh_etl_job_name": "HADOOP_DATASET_METADATA_ETL", "ref_id": 102, "cron_expr": "20 * * * * ?", "properties": {"hdfs.cluster": "hdp24ma", "hdfs.remote.machine": "hdp24ma", "hdfs.private_key_location": "/home/conf/.ssh/id_rsa", "hdfs.remote.jar": "/home/conf/schemaFetch.jar", "hdfs.remote.user": "conf", "hdfs.remote.raw_metadata": "", "hdfs.remote.sample": "", "hdfs.local.field_metadata": "", "hdfs.local.metadata": "", "hdfs.local.raw_metadata": "/home/conf", "hdfs.local.sample": "/home/conf", "hdfs.white_list": "/home/conf/while", "hdfs.file_path_regex_source_map": "" }, "comments": "hdfs metadata etl" }

I cannot see any error printed i nthe console or application.log

I want to submit an ETL job to scan HDFS and perform discovery service for me. Having hard time

sunny1978 commented 8 years ago

Make sure the url is "/etl" but not "/etl/" -- skip the forward slash at end