search

bitnami / vms

Bitnami VMs
https://bitnami.com
Other
206 stars 44 forks source link

[AWS EC2]Server crashes on itself #1059

Closed sindhusr87 closed 1 year ago

sindhusr87 commented 1 year ago

Platform

AWS

bndiagnostic ID know more about bndiagnostic ID

96d7ea0c-3e4c-04b3-3e90-da0a30be7ad0

bndiagnostic output

===== Begin of bndiagnostic tool output =====

✓ Resources: No issues found
✓ Connectivity: No issues found
✓ Mariadb: No issues found
✓ Processes: No issues found
? Wordpress: Found possible issues
? Apache: Found possible issues
✓ Php: No issues found

[Wordpress]

Found recent WordPress plugin related error messages in the Apache error log.

[Tue Jul 25 05:35:00.897647 2023] [proxy_fcgi:error] [pid 305938:tid
140049186174720] (104)Connection reset by peer: [client **ip_address**:60833]
AH01075: Error dispatching request to : , referer:
https://chotu.com/wp-admin/plugins.php?plugin_status=all&paged=1&s

Press [Enter] to continue:

Please check the following guide to deactivate plugins:

https://developer.wordpress.org/cli/commands/plugin/deactivate/

[Apache]

Found recent error or warning messages in the Apache error log.

[Tue Jul 25 05:35:00.899603 2023] [proxy_fcgi:error] [pid 305937:tid
140049110640384] (104)Connection reset by peer: [client **ip_address**:46498]
AH01075: Error dispatching request to :
 [Tue Jul 25 05:35:00.909572 2023] [proxy_fcgi:error] [pid 305938:tid
140049144211200] [client **ip_address**:55904] AH01067: Failed to read FastCGI
header
 [Tue Jul 25 05:35:00.909619 2023] [proxy_fcgi:error] [pid 305938:tid
140049144211200] (104)Connection reset by peer: [client **ip_address**:55904]
AH01075: Error dispatching request to :

Please check the following guide to troubleshoot server issues:

https://docs.bitnami.com/general/apps/wordpress/troubleshooting/debug-erro Press [Enter] to continue: rs-apache/

A high number of incoming requests originate from one or more unique IP addresses. This could indicate a bot attack. The following guide shows how to check for and block suspicious IP addresses.

https://docs.bitnami.com/bch/apps/moodle/troubleshooting/deny-connections- bots-apache/

===== End of bndiagnostic tool output =====

Press [Enter] to continue: Th e diagnostic bundle was uploaded successfully to the Bitnami servers. Please cop y the following code:

96d7ea0c-3e4c-04b3-3e90-da0a30be7ad0

bndiagnostic was not useful. Could you please tell us why?

It doesnt explain in detail about the reason causing the issue

Describe your issue as much as you can

We have a AWS EC2 instance which was running fine for months, all of a sudden from last 2weeks it goes down frequently. Initially it started with server going down on performing an import/export operation. This week it goes down every 5 mins irrespective of performing any operation. Please help us in stabilizing the server as it is affecting our business.

Thank you.

gongomgra commented 1 year ago

Hi @sindhusr87,

Thanks for using Bitnami. I have checked the bndiagnostic bundle information, but I'm afraid I couldn't find anything apart from what the bndiagnostic tool found itself. I see you have many plugins installed, maybe one of them was recently updated and it started causing the errors?

Apart from that, I don't see any resource errors (memory or free disk space), but I see that one IP address is performing a lot of requests to your server. Can you check if it is a bot that is causing the issues?

https://docs.bitnami.com/aws/apps/wordpress/troubleshooting/deny-connections-bots-apache/

-----------------------------------
Check number of lines of Apache access log
-----------------------------------
Running: wc -l access_log
In: /opt/bitnami/apache2/logs/

Output:

32586 access_log

-----------------------------------
Check performance issues: Count number of requests for the 10 most active IP addresses in the last 100.000 requests                                                                                                                                           -----------------------------------
Running: tail -n 100000 access_log | awk '{print $1}' | sort | uniq -c | sort -nr | head -n 10 | awk '{print $1}'
In: /opt/bitnami/apache2/logs/

Output:

15976
2377
1043
479
430
387
360
350
328
310
sindhusr87 commented 1 year ago

Hi,

Thank you so much for your response. We reduced the instance size of the server from t3 large to t3 as we dont have much traffic and that's when the server started going down. I disabled the plugins added recently and ran the diagnostics again. I have shared the output below with you. Please do have a look and let me know if you find any issues.

[image: image.png]

[image: image.png]

[image: image.png]

Thank you, Sindhu

On Fri, 28 Jul 2023 at 20:24, Gonzalo Gómez Gracia @.***> wrote:

Hi @sindhusr87 https://github.com/sindhusr87,

Thanks for using Bitnami. I have checked the bndiagnostic bundle information, but I'm afraid I couldn't find anything apart from what the bndiagnostic tool found itself. I see you have many plugins installed, maybe one of them was recently updated and it started causing the errors?

Apart from that, I don't see any resource errors (memory or free disk space), but I see that one IP address is performing a lot of requests to your server. Can you check if it is a bot that is causing the issues?

https://docs.bitnami.com/aws/apps/wordpress/troubleshooting/deny-connections-bots-apache/

Check number of lines of Apache access log

Running: wc -l access_log In: /opt/bitnami/apache2/logs/

Output:

32586 access_log

Check performance issues: Count number of requests for the 10 most active IP addresses in the last 100.000 requests ----------------------------------- Running: tail -n 100000 access_log | awk '{print $1}' | sort | uniq -c | sort -nr | head -n 10 | awk '{print $1}' In: /opt/bitnami/apache2/logs/

Output:

15976 2377 1043 479 430 387 360 350 328 310

— Reply to this email directly, view it on GitHub https://github.com/bitnami/vms/issues/1059#issuecomment-1655827356, or unsubscribe https://github.com/notifications/unsubscribe-auth/A4ECG4TQ2KADGFHI754K2VLXSPHBVANCNFSM6AAAAAA2WSVE3Y . You are receiving this because you were mentioned.Message ID: @.***>

-- chotu https://chotu.com is India's fastest growing chain of WhatsApp shops. Start your WhatsApp shop, earn upto ₹20K/month.

gongomgra commented 1 year ago

Hi @sindhusr87,

Thanks for your message. Unfortunately, it looks like the images you shared weren't properly uploaded? Can you paste the new bndiagnostic code? Please notice it is easier for us to review pasted text than images.

github-actions[bot] commented 1 year ago

This Issue has been automatically marked as "stale" because it has not had recent activity (for 15 days). It will be closed if no further activity occurs. Thanks for the feedback.

github-actions[bot] commented 1 year ago

Due to the lack of activity in the last 5 days since it was marked as "stale", we proceed to close this Issue. Do not hesitate to reopen it later if necessary.