HoangNV2001 / Real-time-IDS

Real-time Intrusion Detection System implementing Machine Learning. We combine Supervised Learning (RF) for detecting known attacks from CICIDS 2018 & SCVIC-APT datasets, and Unsupervised Learning (AE) for anomaly detection.
28 stars 4 forks source link

research paper #1

Closed advocs closed 6 months ago

advocs commented 7 months ago

can u please share the research paper for this topic so that we can go through the details of this project.

HoangNV2001 commented 6 months ago

Sorry for the late response.

This was a course project. Unfortunately, I cannot share the report. However, I can share with you some links to the papers that I read during the working of this project.

Here are the links for some of the related research papers on the supervised methods:

Links to the supervised datasets:

On the unsupervised methods:

Unfortunately, the link to the unsupervised dataset (SCVIC-APT) is no longer accessible.

Have a good day!

advocs commented 6 months ago

Thank you so much for your response. How should i get the unsupervised dataset now?(SCVIC-APT)

On Tue, Mar 5, 2024, 10:12 PM Nguyễn Việt Hoàng @.***> wrote:

Sorry for the late response.

This was a course project. Unfortunately, I cannot share the report. However, I can share with you some the links to some papers that I read during the working of this project.

Here are the links for some of the related research papers on the supervised methods:

1. https://www.researchgate.net/publication/346184474_A_Real-time_Risk_Assessment_for_Information_System_with_CICIDS2017_Dataset_Using_Machine_Learning

  1. https://arxiv.org/abs/1810.07321

Links to the supervised datasets:

  1. https://www.unb.ca/cic/datasets/ids-2017.html
  2. https://www.unb.ca/cic/datasets/ids-2018.html

On the unsupervised methods: https://ieeexplore.ieee.org/document/7079116

Unfortunately, the link to the unsupervised dataset (SCVIC-APT) is no longer accessible.

Have a good day!

— Reply to this email directly, view it on GitHub https://github.com/HoangNV2001/Real-time-IDS/issues/1#issuecomment-1979191126, or unsubscribe https://github.com/notifications/unsubscribe-auth/A2C4ESNCBA2NVCVEJJIG3WDYWXYVRAVCNFSM6AAAAABCUTGO5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNZZGE4TCMJSGY . You are receiving this because you authored the thread.Message ID: @.***>

HoangNV2001 commented 6 months ago

I found another link: https://ieee-dataport.org/documents/scvic-apt-2021. However, this link requires IEEE DataPort Subscription. The publicly open link is no longer available :(

advocs commented 5 months ago
Hi,I just wanted to ask a doubt regarding this project. Are we gonna do network data capture in this project or should we provide pcap file doing the network data capture from other tools   Sent from Mail for Windows From: Nguyễn Việt HoàngSent: 05 March 2024 22:39To: HoangNV2001/Real-time-IDSCc: aditi hr; AuthorSubject: Re: [HoangNV2001/Real-time-IDS] research paper (Issue #1) I found the link: https://ieee-dataport.org/documents/scvic-apt-2021—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: ***@***.***> 
HoangNV2001 commented 5 months ago

The system captures the real-time network flow of your device

Hi,I just wanted to ask a doubt regarding this project. Are we gonna do network data capture in this project or should we provide pcap file doing the network data capture from other tools   Sent from Mail for Windows From: Nguyễn Việt HoàngSent: 05 March 2024 22:39To: HoangNV2001/Real-time-IDSCc: aditi hr; AuthorSubject: Re: [HoangNV2001/Real-time-IDS] research paper (Issue #1) I found the link: [https://ieee-dataport.org/documents/scvic-apt-2021—Reply](https://ieee-dataport.org/documents/scvic-apt-2021%E2%80%94Reply) to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: ***@***.***>
advocs commented 5 months ago

Thank you for the clarification. Can we use CICIDS2017 dataset from any of links other than ieee?And what are we gonna use for real time network data capturing?

On Mon, Mar 25, 2024, 6:36 AM Nguyễn Việt Hoàng @.***> wrote:

The system captures the real-time network flow of your device

Hi,I just wanted to ask a doubt regarding this project. Are we gonna do network data capture in this project or should we provide pcap file doing the network data capture from other tools Sent from Mail for Windows From: Nguyễn Việt HoàngSent: 05 March 2024 22:39To: HoangNV2001/Real-time-IDSCc: aditi hr; AuthorSubject: Re: [HoangNV2001/Real-time-IDS] research paper (Issue #1 https://github.com/HoangNV2001/Real-time-IDS/issues/1) I found the link: https://ieee-dataport.org/documents/scvic-apt-2021—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you authored the thread.Message ID: @.***>

— Reply to this email directly, view it on GitHub https://github.com/HoangNV2001/Real-time-IDS/issues/1#issuecomment-2017036448, or unsubscribe https://github.com/notifications/unsubscribe-auth/A2C4ESNMEZKFZZ2STHN6UCDYZ52C7AVCNFSM6AAAAABCUTGO5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJXGAZTMNBUHA . You are receiving this because you authored the thread.Message ID: @.***>

HoangNV2001 commented 5 months ago

You can find the link to the CICIDS2017 dataset at the end of this page: https://www.unb.ca/cic/datasets/ids-2017.html This system uses Npcap to capture realtime network data as I have included in the Requirements of README. Our program invokes Npcap by itself to get the network data and perform analyzing, so you don't have to manually capture network data.

advocs commented 5 months ago

Yeah got it, thank you very much. We can use any of the available CICIDS2017 datasets right?or from the link which u have sent. And in which file or folder to copy those datasets in our project?

On Mon, Mar 25, 2024, 1:50 PM Nguyễn Việt Hoàng @.***> wrote:

You can find the link to the CICIDS2017 dataset at the end of this page: https://www.unb.ca/cic/datasets/ids-2017.html This system uses Npcap https://npcap.com/dist/npcap-1.71.exe to capture realtime network data as I have included in the Requirements of README. Our program invokes Npcap by itself to get the network data and perform analyzing, so you don't have to manually capture network data.

— Reply to this email directly, view it on GitHub https://github.com/HoangNV2001/Real-time-IDS/issues/1#issuecomment-2017446965, or unsubscribe https://github.com/notifications/unsubscribe-auth/A2C4ESKMCALOTYLCBLEDXKLYZ7M6BAVCNFSM6AAAAABCUTGO5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMJXGQ2DMOJWGU . You are receiving this because you authored the thread.Message ID: @.***>

HoangNV2001 commented 5 months ago

In this project, I have included the pretrained model. The model is already trained on CICIDS and SCVIC-APT datasets. Thus, it doesn't any dataset to run.

advocs commented 3 months ago

Hey , i just wanted to ask more about the project . The destination IP is not showing and it just shows junk values. If possible can you join the google meet? I'll schedule it today

On Tue, Mar 5, 2024, 10:15 PM Aditi Hr @.***> wrote:

Thank you so much for your response. How should i get the unsupervised dataset now?(SCVIC-APT)

On Tue, Mar 5, 2024, 10:12 PM Nguyễn Việt Hoàng @.***> wrote:

Sorry for the late response.

This was a course project. Unfortunately, I cannot share the report. However, I can share with you some the links to some papers that I read during the working of this project.

Here are the links for some of the related research papers on the supervised methods:

1. https://www.researchgate.net/publication/346184474_A_Real-time_Risk_Assessment_for_Information_System_with_CICIDS2017_Dataset_Using_Machine_Learning

  1. https://arxiv.org/abs/1810.07321

Links to the supervised datasets:

  1. https://www.unb.ca/cic/datasets/ids-2017.html
  2. https://www.unb.ca/cic/datasets/ids-2018.html

On the unsupervised methods: https://ieeexplore.ieee.org/document/7079116

Unfortunately, the link to the unsupervised dataset (SCVIC-APT) is no longer accessible.

Have a good day!

— Reply to this email directly, view it on GitHub https://github.com/HoangNV2001/Real-time-IDS/issues/1#issuecomment-1979191126, or unsubscribe https://github.com/notifications/unsubscribe-auth/A2C4ESNCBA2NVCVEJJIG3WDYWXYVRAVCNFSM6AAAAABCUTGO5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNZZGE4TCMJSGY . You are receiving this because you authored the thread.Message ID: @.***>

advocs commented 3 months ago

Hey do you have any apk to show the demo of how it will react to malicious applications?

On Mon, May 20, 2024, 5:19 PM Aditi Hr @.***> wrote:

Hey , i just wanted to ask more about the project . The destination IP is not showing and it just shows junk values. If possible can you join the google meet? I'll schedule it today

On Tue, Mar 5, 2024, 10:15 PM Aditi Hr @.***> wrote:

Thank you so much for your response. How should i get the unsupervised dataset now?(SCVIC-APT)

On Tue, Mar 5, 2024, 10:12 PM Nguyễn Việt Hoàng @.***> wrote:

Sorry for the late response.

This was a course project. Unfortunately, I cannot share the report. However, I can share with you some the links to some papers that I read during the working of this project.

Here are the links for some of the related research papers on the supervised methods:

1. https://www.researchgate.net/publication/346184474_A_Real-time_Risk_Assessment_for_Information_System_with_CICIDS2017_Dataset_Using_Machine_Learning

  1. https://arxiv.org/abs/1810.07321

Links to the supervised datasets:

  1. https://www.unb.ca/cic/datasets/ids-2017.html
  2. https://www.unb.ca/cic/datasets/ids-2018.html

On the unsupervised methods: https://ieeexplore.ieee.org/document/7079116

Unfortunately, the link to the unsupervised dataset (SCVIC-APT) is no longer accessible.

Have a good day!

— Reply to this email directly, view it on GitHub https://github.com/HoangNV2001/Real-time-IDS/issues/1#issuecomment-1979191126, or unsubscribe https://github.com/notifications/unsubscribe-auth/A2C4ESNCBA2NVCVEJJIG3WDYWXYVRAVCNFSM6AAAAABCUTGO5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNZZGE4TCMJSGY . You are receiving this because you authored the thread.Message ID: @.***>