search

tedbarnett / DreamBuilder

An AR viewer for home additions, pergolas, etc.
2 stars 0 forks source link

Build basic iOS Augmented Reality features #5

Closed tedbarnett closed 4 weeks ago

tedbarnett commented 1 month ago

User should be able to:

tedbarnett commented 1 month ago

Copy any common AR app (or Apple's own demo AR app) for a reference

ChiefSeattle commented 1 month ago

Examples of current AR apps

Fectar - AR viewer. Lots of examples of objects in a space allowing user to walk around object. Most objects lack realistic lighting for the environment - possible to improve for our application?

https://apps.apple.com/app/id1447352798

Trex (deck builder AR app). It recognizes exterior walls and floor planes. Simple onscreen interaction to add/remove features - for our application adding/removing light bar would b nice.

https://apps.apple.com/app/id1561806489

ARKI - AR app with fbx model import options. Requires signup. https://apps.apple.com/us/app/arki/id700695106

Sun seeker - app for Sun trajectory. Wondering if a similar database can be accessed to include a graphic (arc) of solar path over customer's pergola location?

https://apps.apple.com/us/app/sun-seeker-tracker-surveyor/id330247123

bhautikpatoliya004 commented 1 month ago

@tedbarnett @ChiefSeattle I pushed code on the DreamBuilder repo.

When you open an app, there are be 3 options for different 3D files. You can choose any one of them and click on "Place 3D Object" and the AR view opens on the new screen. You need to move your iPhone camera. When the ground surface area is found, the selected 3D object will automatically placed on the ground.

Now, you can zoom, move, rotate, and also added light control to that object.

Currently, I'm working on finding solutions that find wall and ground surfaces as described in the GitHub issue. But the problem is we can place objects on any one surface either ground or wall. So, I'm trying this.

tedbarnett commented 1 month ago

Current alpha demo video at https://drive.google.com/file/d/1Tq-9Fdlk5IjFWpyJMNzLc7XkzXXobO3H/view?usp=drive_link

image

ChiefSeattle commented 1 month ago

Cool!

bhautikpatoliya004 commented 1 month ago

@tedbarnett @ChiefSeattle I've pushed the latest source code to the DreamBuilder repo, including the following updates:

• Improved gestures such as zoom, drag, rotate, and dynamic lighting.

• Ground planes are now dynamically displayed when moving your iPhone. This allows you to place objects manually by touching the desired spot, rather than having the ground plane added automatically upon detection (as it was previously).

Additionally, I think we no longer need to detect wall planes, as 3D objects can now be moved freely to any position.

Could you please try this? and please let me know your feedback.

tedbarnett commented 1 month ago

It's looking awesome, @bhautikpatoliya004 . I think you're right that we don't need the wall plane at this point. Eventually we will want walls (e.g. to project realistic shadows onto the wall), but I'll add that as a separate lower-priority issue.

ChiefSeattle commented 1 month ago

Feedback

Once the floor plane has been established and the 3d object has been placed, the floor plane overlay should disappear

bhautikpatoliya004 commented 1 month ago

@ChiefSeattle Currently, there is an option to remove/show overlay on the ground plan using top right menu button. But if you want then I will remove it once object placed.

ChiefSeattle commented 4 weeks ago

I found the menu item for the overlay...fine like that :)

ChiefSeattle commented 4 weeks ago

Using IPAD pro 12.9" I've noticed the plane overlay is fixed to the movement of the camera and often appears slightly off center.

Also, when I place the object, I cannot move away from the object to look at it from a distance (the object moves with me).

In order to scale the object to a floor and wall, I need to be able to move away from the surfaces with the camera in order to view the entire object. I don't seem to be able to do that currently.