Documentation: add guide on node reuse

DAGWorks-Inc / hamilton

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

https://hamilton.dagworks.io/en/latest/

BSD 3-Clause Clear License

1.82k stars 122 forks source link

Documentation: add guide on node reuse #1045

Open skrawcz opened 3 months ago

skrawcz commented 3 months ago

Is your feature request related to a problem? Please describe. Node reuse is a common question.

We should have a section in the user guide on it.

Describe the solution you'd like The content for this exists. It just needs to be written up / referenced.

Slides from meetup on this - https://github.com/skrawcz/talks/files/14657471/Hamilton.March.2024.Meetup.pdf
youtube video explaining this (see deep dive section)
Notebook that has examples
links to examples in the examples folder that cover this.

Describe alternatives you've considered N/A

Additional context This would be a highly read section.

danieltayal07 commented 1 week ago

is this available for hacktoberfest2024

if yes please assign me this document, i'll make it

i am done with the guide and pulling a request for merger please consider it under hacktoberfest2024

also if possible please add the tags hacktoberfest2024 and hacktoberfest-accepted

Thanks!

skrawcz commented 1 week ago

Thanks @danieltayal07 this needs to fit with our documentation under /docs/how-tos. So your PR will need to be updated to fit with that. I haven't dont a content review to see if it incorporates everything that we need, will try to do that today.

danieltayal07 commented 1 week ago

done, now i have put the guide-reuse-nodes.md in /docs/how-tos.