Open vikranth22446 opened 2 years ago
Thanks for your input, @vikranth22446!
Just to be clear, "every single variable at the end" means every explicitly assigned variable in the outer scope, i.e., of the form
a_var = ...
And not any variables in if statements, loops, functions, etc.
Thanks for clarifying!
Yes, just the exposed variables in the outermost scope would be helpful for my use case. I want to quickly add lineapy to a list of notebooks I'm using.
Yes, just the exposed variables in the outermost scope would be helpful for my use case. I want to quickly add lineapy to a list of notebooks I'm using.
Outermost scope makes sense! Would you mind sharing more what the end to end workflow is? Specifically, once you clean up these notebooks, what do you plan to do next? This would help give us a sense of user scenarios for prioritization.
Thanks!
One sample workflow I'm doing for a ML project:
For steps such as pickle generation, I'd like if linea saved an output file that I could hook to.
Sorry for the delay in response!
Thanks for sharing your workflow. I have a couple followups for your use case.
a) I'd be okay with saving all variables to the artifact store. However, for me, a better experience would a be an artifact store that cleans up after the export. At the end of the file, I'd like to quickly export the code. I care more about the clean code than the variables itself. b) These pickles are generated using an external subprocess. The pickles are not the variables in the current jupyter notebook, but a separate file. c) I don't know what this would look like. Do you have a snippet of what this would look like?
Is your feature request related to a problem? Please describe.
I'd like to quickly export some Jupyter code to a local file(non airflow based) without having to specify artifacts. I don't want to save every single variable at the end(I'd like if it automatically detected it).
Describe the solution you'd like
A clear api to write the output without specifying artifacts.
Is your feature request related to a problem? Please describe. I'd like to quickly export some Jupyter code to a local file(non airflow based) without having to specify artifacts. I don't want to save every single variable at the end(I'd like if it automatically detected it).
Describe the solution you'd like A clear api to write the output without specifying artifacts.