search

Netflix-Skunkworks / Scumblr

Web framework that allows performing periodic syncs of data sources and performing analysis on the identified results
Apache License 2.0
2.64k stars 319 forks source link

Sync Task Error #239

Open apalooza1 opened 6 years ago

apalooza1 commented 6 years ago

Following the guide and setting up my First Sync Task, I get the following error after executing. Any thoughts?

Id | 21 Eventable | Task 2 Action | Error User |   Source | Task: Github Repo Sync Details | Could not parse System Metadata for users/organizations, skipping

sbehrens commented 6 years ago

Did the task still run? That may be a bad debug/error statement. Did you set a user and/or org in the task configuration?

ahoernecke commented 6 years ago

It looks like that error should appear if you've selected a system metadata key for list of organizations/users but the value can't be parsed. Do you have something selected for the "Organization/Users from Metadata" option?

apalooza1 commented 6 years ago

Nothing was selected under org/user. Similar to the guide.

image

apalooza1 commented 6 years ago

Running with 'Netflix', generated error Id 39,

An error occurred in Github Repo Sync. Error: GET https://api.github.com/orgs/Netlfix/repos: 404 - Not Found

sbehrens commented 6 years ago

You need to specify a github org to sync (exp. Netflix) if you are planning on leveraging that task. I'll update the screenshot to reflect that. Can you try adding in an Org and let us know if that resolves the issue?

-Scott

apalooza1 commented 6 years ago

@sbehrens Running with 'Netflix', generated error:

An error occurred in Github Repo Sync. Error: GET https://api.github.com/orgs/Netlfix/repos: 404 - Not Found

sbehrens commented 6 years ago

You spelled Netflix wrong.

apalooza1 commented 6 years ago

That would do it...can't believe I did not catch that.

The task ran and generated results. However it also threw this same error.

Error| "Could not parse System Metadata for users/organizations, skipping"

sbehrens commented 6 years ago

Sounds good, looks like that error message should be a warning or informational. If you feel like submitting a PR to fix that, take a look at: https://github.com/Netflix/Scumblr/blob/master/lib/scumblr_tasks/security/github_analyzer.rb

And what line that exception is being thrown on, most likely the method create_event("string", "Error") can be replaced with create_event("string", "Warn")