search

K3D-tools / K3D-jupyter

K3D lets you create 3D plots backed by WebGL with high-level API (surfaces, isosurfaces, voxels, mesh, cloud points, vtk objects, volume renderer, colormaps, etc). The primary aim of K3D-jupyter is to be easy for use as stand alone package like matplotlib, but also to allow interoperation with existing libraries as VTK.
MIT License
952 stars 122 forks source link

Volume rendering support #22

Closed marcinofulus closed 6 years ago

martinal commented 7 years ago

Are you thinking of volume rendering of structured image data or unstructured meshes as well?

The ipyvolume project has some functionality for the former and I've been looking at prototyping volume rendering for tetrahedral meshes lately within the constraints of webgl(2)/three.js and believe I'm close to having something functional.

artur-trzesiok commented 7 years ago

That's depend on needs. I guess that structured image data are more important ( @marcinofulus ?) but as always - adding a new additional feature increase usability of tool :). I like AMI.js implementation of one-pass rendering for structured image data. The problem is that webgl have lack of support 3d textures. That force us to implement texture sampling with filtering manually in shaders. I still try to find the best approach to do this.

about your code: can we see it somwehere? Or look at results images?

martinal commented 7 years ago

webgl2 has 3d textures, if only three.js could get the WebGL2Renderer going...

I'm not sure how ipyvolume has solved it but you can see here https://github.com/maartenbreddels/ipyvolume/

Maybe @maartenbreddels is interested in collaborating, ipyvolume and k3d are covering much of the same ground.

You don't want to see my code yet, I'll let you know as soon as I have a minimal example to show.

maartenbreddels commented 7 years ago

Hi all,

I basically tile the 3d texture and sample it in the shader I did notice some artifacts sometimes, so I have to go over it once more to maybe get the +0.5's etc correct. We both have a MIT Licence, so code sharing shouldn't be a problem (both ways). Tiling/serializing the 3d cube is done on the Python side Did you think about how to render both volumes and solids in one scene?

I definitely see value in collaboration, happy to help, share etc :+1: . I'm not sure merging of the projects is an option, either way. I'm not sure our goals are similar and if there are other issues that could prevent this.

cheers,

Maarten

artur-trzesiok commented 6 years ago

Hi,

I added to threejs support for Textures3D: https://github.com/mrdoob/three.js/pull/14530

Proof of concept video:

Image:

preview

preview2