Currently, the transform functions in common-loaders return a List. We construct the list by concatenating two lists: 1 for atomic fields and 1 for the self-describing entity fields (this line).
The ::: operator is relatively expensive, especially for large lists. And this is a “hot” function which we invoke for every single event.
If we switch the implementation to use Vector instead of List then it should be much more efficient to concatenate the two lists.
Currently, the transform functions in common-loaders return a List. We construct the list by concatenating two lists: 1 for atomic fields and 1 for the self-describing entity fields (this line).
The
:::operator is relatively expensive, especially for large lists. And this is a “hot” function which we invoke for every single event.If we switch the implementation to use Vector instead of List then it should be much more efficient to concatenate the two lists.