search

smartcorelib / smartcore

A comprehensive library for machine learning and numerical computing. The library provides a set of tools for linear algebra, numerical computing, optimization, and enables a generic, powerful yet still efficient approach to machine learning.
https://smartcorelib.org/
Apache License 2.0
705 stars 77 forks source link

[Ethics] interpretability, accessibility, integration #92

Open Mec-iS opened 3 years ago

Mec-iS commented 3 years ago

I write here some general concepts as a references or notes for bits that could be helpful to the community. I suggest reading this paper for an overview of current and possible scenarios for ML applications.

Are interpretability principles something that should be embedded in software libraries or workflows? If yes, how can an API avoid software developers to take shortcuts to black-boxes and nudge to tackle interpretability-by-design when writing code? Is this desirable?

A missing point in the paper imo is the lack of addressing data quality and dataset growth. There should be an "evolutionary" perspective on the model performance as the dataset grows in time: i.e. which characteristics newly added data should have to improve global performance and how to monitor (data-centric MLOps approach)

Mec-iS commented 2 years ago

I am trying to improve accessibility to our API by creating a gRPC service to run smartcore in a remote service (using tokio, tonic etc.). Just started and looking for help and support https://github.com/Mec-iS/rust-grpc-smartcore

Mec-iS commented 2 years ago

There is drafting process started for WebAssembly Component Model to improve usability and integration of wasm binaries.

Also Riff is a package manager that will allow multilanguage builds