search

pengHTYX / Era3D

GNU Affero General Public License v3.0
536 stars 24 forks source link

Can I create additional images from another angles ? #36

Open altava-sgp opened 3 months ago

altava-sgp commented 3 months ago

As you know Era3D creates 12 images like below. image

I can see the source code too.

VIEWS = ['front', 'front_right', 'right', 'back', 'left', 'front_left']

I wonder that if I can create additional images from another angles like this. image

These are from another angles. If fact I am studying this. https://github.com/Profactor/continuous-remeshing You mentioned this here. https://github.com/pengHTYX/Era3D/issues/8#issuecomment-2144521905

If I can create those images I can upgrade mesh quality as far as I think. What do you think about this ? Can I get any help for this ?

pengHTYX commented 3 months ago

Hi, Era3D does not currently support generating multiple views at different elevations as shown. I kindly suggest referring to this work for a possible solution.

altava-sgp commented 3 months ago

@pengHTYX Thanks for your answer. But they don't provide code yet. 😢

altava-sgp commented 3 months ago

Besides it didn't guess well about backside as I see. Era3D is much better. 👍

pengHTYX commented 3 months ago

@pengHTYX Thanks for your answer. But they don't provide code yet. 😢

That's exactly the issue. lol

xiyichen commented 3 months ago

I guess you could use NeuS to do novel view synthesis. Btw, is the maximum number of views that the model could generate limited to 8?

pengHTYX commented 3 months ago

I guess you could use NeuS to do novel view synthesis. Btw, is the maximum number of views that the model could generate limited to 8?

We have not tested the upper limit, but it works for 8-view generation.

xiyichen commented 3 months ago

Do I have to retrain the method for 8-view generation or can I just use the pretrained 6-view model for that?

pengHTYX commented 3 months ago

You should train it.

xiyichen commented 3 months ago

Thanks. I have one more question, is it possible to generate views directly with perspective projection? I'm trying to train 3DGS on Era3D results but its rasterizer doesn't seem directly compatible with orthographic projection.