search

alicevision / Meshroom

3D Reconstruction Software
http://alicevision.org
Other
11.23k stars 1.09k forks source link

AI ideas reveal a new way of thinking #2185

Open Chunky8919 opened 1 year ago

Chunky8919 commented 1 year ago

Discussed in https://github.com/alicevision/Meshroom/discussions/2184

Originally posted by **Mazhivee** September 8, 2023 Automated Image Enhancement: Implement AI-based algorithms for automatic image enhancement, including denoising, color correction, and contrast adjustment. This would improve the quality of input images, leading to better 3D reconstructions. There are pre-trained AI models and libraries available that can be integrated for this purpose. Feature Detection and Matching: Enhance the feature detection and matching process using AI-based methods. These methods can help improve the accuracy and speed of this crucial step in photogrammetry. Libraries like OpenCV offer AI-powered feature detection algorithms. Depth Estimation: Implement AI-based depth estimation algorithms to generate initial depth maps from 2D images. Depth maps can serve as a valuable starting point for the photogrammetry process, and AI-driven depth estimation can be faster and more accurate than traditional methods. Quality Control: Develop AI modules to automatically identify common issues in the reconstruction process, such as outliers, artifacts, or incomplete reconstructions. The AI could then provide feedback or recommendations to the user. Real-time Guidance: Implement AI-powered real-time guidance during the image capture process. For example, the software could suggest optimal camera positions or angles to ensure a successful reconstruction. Texture Mapping Assistance: Utilize AI to automate the texture mapping process and address common issues like texture seams. This would make the final 3D models look more polished. User-Friendly Tutorials: Develop AI-driven tutorials or tooltips that guide users through the photogrammetry process step by step. These can provide immediate assistance to users, especially beginners. Hardware Profiling: Use AI to profile the user's hardware and optimize the processing parameters accordingly. This can ensure that Meshroom runs efficiently on various systems. these are some ideas we think would be very nice...
ShinyJustyZ commented 12 months ago

While these are great ideas, not everything has to have AI included in them. It would also be a time-consuming process to implement something like this