Closed Phileodontist closed 1 month ago
{
"id": "2023_deployment_of_real_time_network_traffic_analysis_using_graphblas_hyperspace_matrices_and_d4m_associative_arrays",
"name": "Deployment of Real-Time Network Traffic Analysis Using GraphBLAS Hypersparse Matrices and D4M Associative Arrays",
"datePublished": "2023.00",
"publisher": "2023 IEEE High Performance Extreme Computing Conference (HPEC)",
"description": "Matrix/array analysis of networks can provide significant insight into their behavior and aid in their operation and protection. Prior work has demonstrated the analytic, performance, and compression capabilities of GraphBLAS (graph-blas.org) hypersparse matrices and D4M (d4m.mit.edu) associative arrays (a mathematical superset of matrices). Obtaining the benefits of these capabilities requires integrating them into operational systems, which comes with its own unique challenges. This paper describes two examples of real-time operational implementations. First, is an operational GraphBLAS implementation that constructs anonymized hypersparse matrices on a high-bandwidth network tap. Second, is an operational D4M implementation that analyzes daily cloud gateway logs. The architectures of these implementations are presented. Detailed measurements of the resources and the performance are collected and analyzed. The implementations are capable of meeting their operational requirements using modest computational resources (a couple of processing cores). GraphBLAS is well-suited for low-level analysis of high-bandwidth connections with relatively structured network data. D4M is well-suited for higher-level analysis of more unstructured data. This work demonstrates that these technologies can be implemented in operational settings.",
"tags": [],
"links": [],
"authors": [
{
"person": "person:jones__michael",
"organizations": [
"MIT"
]
},
{
"person": "person:kepner__jeremy",
"organizations": [
"MIT"
]
},
{
"person": "person:prout__andrew",
"organizations": [
"MIT"
]
},
{
"person": "person:davis__timothy",
"organizations": [
"MIT"
]
},
{
"person": "person:arcand__william",
"organizations": [
"MIT"
]
},
{
"person": "person:bestor__david",
"organizations": [
"MIT"
]
},
{
"person": "person:bergeron__william",
"organizations": [
"MIT"
]
},
{
"person": "person:byun__chansup",
"organizations": [
"MIT"
]
},
{
"person": "person:gadepally__vijay",
"organizations": [
"MIT"
]
},
{
"person": "person:houle__micheal",
"organizations": [
"MIT"
]
},
{
"person": "person:hubbell__matthew",
"organizations": [
"MIT"
]
},
{
"person": "person:Jananthan__hayden",
"organizations": [
"MIT"
]
},
{
"person": "person:klein__anna",
"organizations": [
"MIT"
]
},
{
"person": "person:milechin__lauren",
"organizations": [
"MIT"
]
},
{
"person": "person:morales__guillermo",
"organizations": [
"MIT"
]
},
{
"person": "person:mullen__julie",
"organizations": [
"MIT"
]
},
{
"person": "person:patel__ritesh",
"organizations": [
"MIT"
]
},
{
"person": "person:pisharody__sandeep",
"organizations": [
"MIT"
]
},
{
"person": "person:reuther__albert",
"organizations": [
"MIT"
]
},
{
"person": "person:rosa__antonio",
"organizations": [
"MIT"
]
},
{
"person": "person:samsi__siddharth",
"organizations": [
"MIT"
]
},
{
"person": "person:yee__charles",
"organizations": [
"MIT"
]
},
{
"person": "person:michaleas__peter",
"organizations": [
"MIT"
]
}
],
"resources": [
{
"name": "HTML",
"url": "https://ieeexplore.ieee.org/document/10363581/authors#authors"
}
]
}
[
{
"id": "person:jones__michael",
"organizations": [
"MIT"
],
"nameLast": "Jones",
"nameFirst": "Michael",
"name": "Jones, Michael"
},
{
"id": "person:kepner__jeremy",
"organizations": [
"MIT"
],
"nameLast": "Kepner",
"nameFirst": "Jeremy",
"name": "Kepner, Jeremy"
},
{
"id": "person:prout__andrew",
"organizations": [
"MIT"
],
"nameLast": "Prout",
"nameFirst": "Andrew",
"name": "Prout, Andrew"
},
{
"id": "person:davis__timothy",
"organizations": [
"MIT"
],
"nameLast": "Davis",
"nameFirst": "Timothy",
"name": "Davis, Timothy"
},
{
"id": "person:arcand__william",
"organizations": [
"MIT"
],
"nameLast": "Arcand",
"nameFirst": "William",
"name": "Arcand, William"
},
{
"id": "person:bestor__david",
"organizations": [
"MIT"
],
"nameLast": "Bestor",
"nameFirst": "David",
"name": "Bestor, David"
},
{
"id": "person:bergeron__william",
"organizations": [
"MIT"
],
"nameLast": "Bergeron",
"nameFirst": "William",
"name": "Bergeron, William"
},
{
"id": "person:byun__chansup",
"organizations": [
"MIT"
],
"nameLast": "Byun",
"nameFirst": "Chansup",
"name": "Byun, Chansup"
},
{
"id": "person:gadepally__vijay",
"organizations": [
"MIT"
],
"nameLast": "Gadepally",
"nameFirst": "Vijay",
"name": "Gadepally, Vijay"
},
{
"id": "person:houle__micheal",
"organizations": [
"MIT"
],
"nameLast": "Houle",
"nameFirst": "Micheal",
"name": "Houle, Micheal"
},
{
"id": "person:hubbell__matthew",
"organizations": [
"MIT"
],
"nameLast": "Hubbell",
"nameFirst": "Matthew",
"name": "Hubbell, Matthew"
},
{
"id": "person:jananthan__hayden",
"organizations": [
"MIT"
],
"nameLast": "Jananthan",
"nameFirst": "Hayden",
"name": "Jananthan, Hayden"
},
{
"id": "person:klein__anna",
"organizations": [
"MIT"
],
"nameLast": "Klein",
"nameFirst": "Anna",
"name": "Klein, Anna"
},
{
"id": "person:milechin__lauren",
"organizations": [
"MIT"
],
"nameLast": "Milechin",
"nameFirst": "Lauren",
"name": "Milechin, Lauren"
},
{
"id": "person:morales__guillermo",
"organizations": [
"MIT"
],
"nameLast": "Morales",
"nameFirst": "Guillermo",
"name": "Morales, Guillermo"
},
{
"id": "person:mullen__julie",
"organizations": [
"MIT"
],
"nameLast": "Mullen",
"nameFirst": "Julie",
"name": "Mullen, Julie"
},
{
"id": "person:patel__ritesh",
"organizations": [
"MIT"
],
"nameLast": "Patel",
"nameFirst": "Ritesh",
"name": "Patel, Ritesh"
},
{
"id": "person:pisharody__sandeep",
"organizations": [
"MIT"
],
"nameLast": "Pisharody",
"nameFirst": "Sandeep",
"name": "Pisharody, Sandeep"
},
{
"id": "person:reuther__albert",
"organizations": [
"MIT"
],
"nameLast": "Reuther",
"nameFirst": "Albert",
"name": "Reuther, Albert"
},
{
"id": "person:rosa__antonio",
"organizations": [
"MIT"
],
"nameLast": "Rosa",
"nameFirst": "Antonio",
"name": "Rosa, Antonio"
},
{
"id": "person:samsi__siddharth",
"organizations": [
"MIT"
],
"nameLast": "Samsi",
"nameFirst": "Siddharth",
"name": "Samsi, Siddharth"
},
{
"id": "person:yee__charles",
"organizations": [
"MIT"
],
"nameLast": "Yee",
"nameFirst": "Charles",
"name": "Yee, Charles"
},
{
"id": "person:michaleas__peter",
"organizations": [
"MIT"
],
"nameLast": "Michaleas",
"nameFirst": "Peter",
"name": "Michaleas, Peter"
}
]
paper
catalog entry https://ieeexplore.ieee.org/document/10363581Use the following as an example on how to create a
paper
catalog entry https://github.com/CAIDA/catalog-data/blob/master/sources/paper/2014_hell_of_a_handshake_abusing_TCP_for_reflective_amplification_ddos_attacks.jsonperson
catalog entryUse the following as an example on how to create a
person
catalog entry https://github.com/CAIDA/catalog-data/blob/master/sources/person/jonker__mattijs.jsonNote: Make sure that the
person
object doesn't already exist