Use a temporary directory for pulling scripts instead of building in the repo itself

[aiyengar2]

@rohitsakala not sure if these needs more reviews but feel free to merge if it's good to go.

I'm not actively looking at this PR or making any more changes (unless requested).