Now that pandas data frame is a supported input data source, we will extend functionality further to include an option to specify either a SAS dataset or a CAS table as a data source.
Why?
Given the main objective of providing tools which make it easier to integrate LLMs into the Viya ecosystem, this is a natural direction to go towards. Data in the Viya ecosystem resides in SAS datasets, CAS tables or sources from databases and external data sources, manifested either as a SAS dataset or CAS table.
How?
An input data source will be added to the custom step
Code will convert input dataset to pandas data frame
Pandas data frame will be stored to Chroma vector store
Now that pandas data frame is a supported input data source, we will extend functionality further to include an option to specify either a SAS dataset or a CAS table as a data source.
Why? Given the main objective of providing tools which make it easier to integrate LLMs into the Viya ecosystem, this is a natural direction to go towards. Data in the Viya ecosystem resides in SAS datasets, CAS tables or sources from databases and external data sources, manifested either as a SAS dataset or CAS table.
How?