Handling Remote Data - Githubissues

datamade / data-making-guidelines

:blue_book: Making Data, the DataMade Way

MIT License

287 stars 19 forks source link

Handling Remote Data #4

Open hunterowens opened 9 years ago

hunterowens commented 9 years ago

Was wondering if you have been able to integrate make into workflows that require working with remote services/servers? I've generally had to turn to Drake or Luigi in these use cases, but being able to use make in this situation would be great...

fgregg commented 9 years ago

Could you describe a concrete use case a little bit more. We use lots of web services to get data, but I'm not sure if that's what you mean?

hunterowens commented 9 years ago

More of a working with multiple remote machines or a cluster, I guess...

fgregg commented 9 years ago

Sorry, I still have no idea what you are trying to do? Distributing tasks to many machines? Could you describe a concrete task you did?