cvandeplas / pystemon

Monitoring tool for PasteBin-alike sites written in Python. Inspired by pastemon http://github.com/xme/pastemon
GNU Affero General Public License v3.0
334 stars 224 forks source link

Pastebin_Pro - Error in your regex #93

Closed timhux123 closed 6 years ago

timhux123 commented 6 years ago

Signed up and received a pastebin pro account and receive the error below after adding the Developer API Key to the configuration. The feed dumps the paste to the screen and does not add them to AIL. Slexy and codepad feeds are working successfully. The issue is only with the pastebin pro config.

"No last pasties matches for regular expression site:pastebin.com_pro regex:"123456790ABCDEFGHIJ": "(.+)",. Error in your regex? Dumping htmlPage"

My pastebin.com pro account configuration in pystemon.yaml:

pastebin.com_pro: archive-url: 'https://scrape.pastebin.com/api_scraping.php?limit=500' archive-regex: '"123456790ABCDEFGHIJ": "(.+)",' download-url: 'https://scrape.pastebin.com/api_scrape_item.php?i={id}' public-url: 'https://pastebin.com/raw/{id}' update-max: 50 update-min: 40

cvandeplas commented 6 years ago

You should not change the regex in the yaml. Normally pastebin allows you to whitelist your public IP. No API key needs to be added to the yaml file.

Did this behaviour change? See the URL given in the yaml file pointing to the page where you can whitelist your IP.

Unfortunately I barely have access to the web for two weeks and can't have a look myself to check if things changed.

On Tue, 18 Sep 2018, 18:02 timhux123, notifications@github.com wrote:

Signed up and received a pastebin pro account and receive the error below after adding the api key to the configuration. The feed dumps the paste to the screen and does not add them to AIL. Slexy and codebase feeds are working successfully. The issue is only with the pastebin pro config.

"No last pasties matches for regular expression site:pastebin.com_pro regex:"123456790ABCDEFGHIJ": "(.+)",. Error in your regex? Dumping htmlPage"

My pastebin.com pro account configuration in pystemon.yaml:

pastebin.com_pro: archive-url: 'https://scrape.pastebin.com/api_scraping.php?limit=500' archive-regex: '"123456790ABCDEFGHIJ": "(.+)",' download-url: 'https://scrape.pastebin.com/api_scrape_item.php?i={id}' public-url: 'https://pastebin.com/raw/{id}' update-max: 50 update-min: 40

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/cvandeplas/pystemon/issues/93, or mute the thread https://github.com/notifications/unsubscribe-auth/ABBh_gv35nzJf8Nas-iQy90Zldvgb8FGks5ucRkOgaJpZM4WuPub .

timhux123 commented 6 years ago

Thanks for the pointers! You are correct, I was under the impression the "key" value in the regex was a place holder for your own pastebin api key. I changed the pastebin pro config in the yaml file back to the default and white listed my IP. All working now.