distributed use cases?

[vsoch]

Hi! I'm looking for a go framework to run experiments on an HPC cluster, and I'm wondering if any of your simulations are amenable to that? Basically I can have a set of connected nodes and (if the library supports something like distributed) I'm hoping to use them. Thanks!

[sbinet]

hi there,

(apologies for the belated answer, I was out of commission for a week)

what's your use-case, really ? (is it running a Delphes-like simulation (i.e.: fads), or something completely "new", from first principles ? is ROOT output involved ? is it pure MonteCarlo ? reco+simulation ?)

Go-HEP didn't really look at the distributed use-case, unfortunately. For the ALICE experiment, I played a bit with implementing a distributed-friendly framework in Go, compatible with their C++-based one:

• https://github.com/alice-go/fer but in the end they weren't that interested in really playing the multi-language game...

long story short, I guess for HPC, MPI is an obvious answer. On the gonum mailing list somebody had posted a pure-Go implementation of MPI:

• https://github.com/btracey/mpi it's old, but not as old as MPI :}

perhaps you might have more luck on the Gonum mailing list ?

hth, -s

(also, Go-HEP does have a mailing list: https://lists.sr.ht/~sbinet/go-hep)

[vsoch]

These are fantastic! It may seem like a tiny thing, but I will definitely try them out. It's unfortunate there isn't more work of this type with Go. Understandably most folks like MPI for HPC, but I think Go has a lot of interesting scientific use cases (and especially for distributed). Anyway, I really appreciate your insights.

[vsoch]

hey @sbinet I'm trying to bring life back to the project, and (if nothing but a learning exercise) it's been really fun so far! I was able to implement the sampler-to-sink example, here and I was wondering if I could ask for help with the request reply? I'm following (what I perceive to be) the logic in the FairMQ example, but my message is never received by the server. If you might be able to take a look and give me some hints, I'm hoping to get this one working, then try the router/dealer pattern, and my ultimate goal is to have something that can send pair to pair messages between nodes (if that is possible). And apologies for my naivete - I'm new to developing with these. Thank you!