Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objects

Raphael Bensadoun, Yanir Kleiman, Idan Azuri, Omri Harosh, Andrea Vedaldi, Natalia Neverova, Oran Gafni·July 02, 2024

Summary

Meta 3D TextureGen is a state-of-the-art method developed by Meta for generating high-quality, globally consistent textures for 3D objects. It uses a two-stage process: a geometry-aware text-to-image model for multi-view rendering and a UV-space network for refinement and resolution enhancement. The technique conditions the model on 3D semantics, ensuring text faithfulness and fast inference (under 20 seconds). It outperforms existing methods in terms of consistency, quality, and speed, making it suitable for real-world applications like gaming and design. The study includes evaluations using quantitative metrics and user preferences, demonstrating the method's superiority over alternatives. However, it has some limitations, such as the need for a 3D dataset and not supporting PBR material maps.

Key findings

11

Tables

2

Advanced features