magnetarpulse / neurobazaar

Interactive Visualization Platform for Machine Learning and Data Science Datasets
GNU General Public License v3.0
0 stars 1 forks source link

Rewriting core #27

Open HuyNguyenDePaul opened 1 month ago

HuyNguyenDePaul commented 1 month ago

I have been thinking recently about rewriting some of the core components of the trame server(s).

I want to:

  1. Optimize the code. I was thinking of writing some of it directly in C++. Other aspects, include also using libraries which support GPU usage to boost performance.
  2. Rewrite current applications, like the Out-of-Distribution (OoD) interface, to be more efficient by using tools such as VTK.
  3. Resolve the issue of port consumption. Each trame server currently uses a separate port, and since there are only 65,535 TCP ports available (due to the 16-bit field structure in TCP/UDP protocols), we will eventually run out of ports if this continues.