search

reqnroll / Reqnroll

Open-source Cucumber-style BDD test automation framework for .NET.
https://reqnroll.net
BSD 3-Clause "New" or "Revised" License
310 stars 32 forks source link

Broken links for documentation (docs.reqnroll.net is not accessible) #79

Closed MarkvTurnhout closed 1 month ago

MarkvTurnhout commented 4 months ago

Related Documentation Page

https://docs.reqnroll.net/

Type of the problem

Broken link or display

Problem Description

Hello,

If this is not the right place for this question please let me know :).

I am trying to reach the documentation page but i get a "Hmmm… can't reach this page" error. Could u update the link?

Broken link: https://docs.reqnroll.net/

Thank you,

Mark

ajeckmans commented 4 months ago

It is working for me. Is anything on the domain working for you? It is a relatively new domain so some dns providers will block the requests when certain safety features are turned on. Notably I had this issue with nextdns.

gasparnagy commented 4 months ago

It is also working for me, but someone else have reported the same issue to me per email. The domain is more than a month old.

Maybe related: Kaspersky classified our documentation site as "pishing", because the site is hosted (by ReadTheDocs) on a server where someone else published some malware.

I have reported the issue both for Kaspersky and ReadTheDocs on Monday.

I have received a response from Kaspersky today that they excluded us from our data loss threat protection databases.

I haven't received a solution from ReadTheDocs yet, but maybe they are currently reconfiguring the servers...

@MarkvTurnhout: I have a few questions

MarkvTurnhout commented 4 months ago

From my work laptop the ping doesn't work, I just tried outside the network (on my phone) and it works.

So it seems to be a internal thingy. I will ask the network guys if they can allow it.

Thank you for the quick response!

gasparnagy commented 4 months ago

@MarkvTurnhout thx. please report it back here if it was really an internal thing.

MarkvTurnhout commented 3 months ago

I just got word back from our IT department. It seems that we do not support IPv6 addresses,

I did a ping from my local laptop:

image

I don't know if it is possible to also host / broadcast the docs.reqnroll.net page with / on IPv4? I don't have a lot of knowledge about this so I don't know if it is possible?

gasparnagy commented 3 months ago

@MarkvTurnhout thx for the info. I don't really understand this, because docs.reqnroll.net does have an IPv4 address as well. For me ping does use that.

image

MarkvTurnhout commented 3 months ago

I have to admit this goes further then my knowledge about this subject :P.

We have send it back to our IT Department, hopefully they have a way forward. I'll get back on this issue.

gasparnagy commented 3 months ago

@MarkvTurnhout In the meantime I tried to convince all security providers to clear the malicious flag from docs.reqnroll.net and it goes well. There is only one that has not processed my request yet (see report).

ajeckmans commented 3 months ago

Just a heads up that on the Odido mobile network (https://www.odido.nl/) in the Netherlands (formerly T-Mobile NL) the docs.reqnroll.net site also won't load.

gasparnagy commented 3 months ago

@ajeckmans Any chance that you can contact Odido support to get info on "why" it is not available there? I feel that there is a problem, but we still don't know what it is. I guess the website (reqnroll.net) is loading, right?

ajeckmans commented 3 months ago

Yes the regular website is loading just fine. I can try but their servicedesk is not known for their technical expertise..

ajeckmans commented 3 months ago

@gasparnagy Just connected my pc via odido mobile network to try and get some tracing and of course it started working. I'm hoping the same goes for @MarkvTurnhout as well.

mooragor commented 3 months ago

Following up here from https://github.com/orgs/reqnroll/discussions/102 My phone can indeed access the docs websites. Am raising a ticket with my ISP to try and find out why the docs are being blocked. Don't hold your breath waiting for a meaningful reply! :) https://community.plus.net/t5/Broadband/Access-Denied-to-a-sub-website/td-p/1966142

mooragor commented 3 months ago

So - someone replied there that on the same ISP their iPad worked and desktop didn't. They had 'Malwarebytes' security software. I have company mandated 'Netscope' - and turning that off temporarily allowed the page to load. I'll try a support ticket with the company's IT people to see if they can get an answer from Netscope on why it's blocked.

mooragor commented 3 months ago

Apparently Malwarebytes is classifying the website as 'riskware' - for an unknown reason. I'll see what our IT says about the reason for Netscope not liking it - probably the same 'blacklist' - no clue at all how you'd manage to get the site off whatever blacklist it's managed to get on!

gasparnagy commented 3 months ago

@mooragor thx for your help so far. It seems that the on the same server where our docs is hosted at read-the-docs, someone else published some malware, so that IP address as added to blocklists. Now we need to convince them that this is a shared server, and our docs site is clear. For Malwarebytes you can report such "false positives" at https://forums.malwarebytes.com/forum/123-website-blocking/ (unfortunately it requires signup).

Could you make a ping docs.reqnroll.net on your desktop to know which IP address is used for the site at your location?

mooragor commented 3 months ago 
ping docs.reqnroll.net
Pinging readthedocs.io [104.17.32.82] with 32 bytes of data:
Reply from 104.17.32.82: bytes=32 time=19ms TTL=57
gasparnagy commented 3 months ago

@mooragor I see. For me it is 104.17.33.82. I wonder whether the block is only for that IP or all the IP range used...

If I may use your time a bit more: could you please add a line

104.17.33.82    docs.reqnroll.net

to your C:\Windows\System32\drivers\etc\hosts file (you can edit it as admin with notepad) temporarily and try to access the site again from a new browser (the best is if you use a different browser (e.g. edge instead of chrome) so that it surely does not use a cached IP)?

mooragor commented 3 months ago

Doing that let the docs site load.

mooragor commented 3 months ago

Also, even after removing that from /etc/hosts again, the docs are still loading for me. Ping (new command window) is bringing back 104.17.33.82 as the IPaddress still.

mooragor commented 3 months ago

Our IT team also report the same sort of 'it's been flagged as potentially malicious' reason for Netscope blocking it.

"It appears those two subdomains for Reqnroll have been flagged as having hosted malicious resources, or have been potentially compromised. Can you please share this with them, as that's why we cannot access them."

gasparnagy commented 3 months ago

Thx @mooragor!

Doing that let the docs site load.

Yeah. So it seems that the problem is not with the subdomain (as the IT team said), but the IP address, as I suspected, that we cannot really do anything with, except change the hosting to somewhere else.

Also, even after removing that from /etc/hosts again, the docs are still loading for me

That's just the browser caching the IP probably... :(

It appears those two subdomains for Reqnroll have been flagged as having hosted malicious resources, or have been potentially compromised. Can you please share this with them, as that's why we cannot access them.

Maybe you can explain them the situation (it is a shared server) and report it as false positive helps... But this seems to be an endless fight...

I think we should really consider to host the docs site ourselves. It is a static site, so hosting is not a big deal (I did it for test as documentation.reqnroll.net), but the automatic update is complicated.

If anyone have a good idea what to do, please let me know.

erlingbo commented 2 months ago

The dns provider at my company blocks all traffic to any (sub)domain related to reqnroll.net, including www, docs and reqnroll.net itself. It is reported by checkpoint as a site "known to contain malware". Our IT department recommends that you get in touch with checkpoint to remove this classification. image (3)

image (4)

gasparnagy commented 2 months ago

@erlingbo thx. I will report it as false positive at Check Point ThreatCloud... Grrrr.

Feels like an endless fight...

gasparnagy commented 2 months ago

I have reported it. It was also misclassified by Webroot / OpenText, I reported there and it was cleared promptly.

gasparnagy commented 2 months ago

@erlingbo I have received the feedback from Check Point ThreatCloud that they have removed the false positive classification. So it should now work again at your company...

gasparnagy commented 2 months ago

After a month and a lot of false positive report, both the docs and the normal website is reported to be clean on VirusTotal: https://www.virustotal.com/gui/url/33f44d1a199c14928b72def82bc10f9ef7da757620854d94937f6b5507351195?nocache=1.

We are at least one step further.

But there might be still vendors (like Check Point ThreatCloud used by @erlingbo 's company) that are not reporting to VirusTotal, so might block our sites still.

Please keep reporting if you see issues.

MarkvTurnhout commented 2 months ago

For me it is working on my work laptop.

I am now getting the V4 IP for both webpages:

image

Thanks everybody for their help!

For me this ticket could be closed, but seeing as there are more people with issues maybe keep it open?

gasparnagy commented 1 month ago

I haven't got further reports about server block for a while, so I close this issue, but please reopen if reqnroll.net or docs.reqnroll.net is not accessible from your company network.