Open da-liii opened 2 years ago
Another related here that could be super useful is to specify results to get from certain layers. Right now if we want to do model introspection we need to specifically implement a new model explicitly. Instead it would be great to be able to extract features from intermediate layers without reimplementing (eg embeddings, candidate label scores etc). Cc @eddyxu wdyt?
schema pruning can be done.
Could you elaborate what is the use case for schema pruning
? It is not clear to me why we want to do it instead just do data manipulation via SQL. It does add quite some complexity to ModelType, and makes the ModelType interface wider.
Another related here that could be super useful is to specify results to get from certain layers.
Yea, this could be great. Lets do some research to see whether we can achieve a common pattern here?
For example, we define
as OUTPUT_SCHEMA.
When
schema pruning can be done.