Implement local caching of asset files

[jonathantopf]

It would sometimes be useful when rendering on slow network connections to be able to force appleseed to load all dependencies such when rendering begins.

[dictoon]

As discussed, it would make more sense to implement local caching of on-demand loaded resources such as texture files.

[Narann]

I think a local caching + p2p transfert between nodes would be great.

The point is, when you render a frame, to send to each node a list of node currently working on this scene. So if a node need a ressource, it will ask his "friend of scene" first and get the cache data from it.

This way each node could also unload some part of it cache but know who ask first to know if it still have a cached part. Nodes can share the "cache hash" of each others.

Te points are:

• Avoid massive file IO on one particular file when render start (24 nodes asking for the same texture). So I don't recommend to load all dep before render start.
• Keep the "source network" clean, making nodes sharing what they have (cache hash shouldn't be huge data transfert I guess).

I wonder if VRay is not working on something similar (p2p cache network). I think it's a very good idea.

Once again: My 2 cts.

Regards,

Dorian

Le 2014-01-26 13:58, François Beaune a écrit :

As discussed, it would make more sense to implement local caching of on-demand loaded resources such as texture files.

On Sun, Jan 26, 2014 at 6:26 PM, Jonathan Topf notifications@github.comwrote:

It would sometimes be useful when rendering on slow network connections to be able to force appleseed to load all dependencies such when rendering begins

— Reply to this email directly or view it on GitHubhttps://github.com/appleseedhq/appleseed/issues/294 .

— Reply to this email directly or view it on GitHub https://github.com/appleseedhq/appleseed/issues/294#issuecomment-33326451.

[dictoon]

That's a very interesting idea.

Also, I think it would be an ideal project for a Google Summer of Code participant.