ShanghaiTech University

Scientists at ShanghaiTech University recently developed an AI model called CLAY that can generate detailed 3D objects from text descriptions or 2D images. Compared with previous technologies, CLAY has achieved significant breakthroughs in both the quality and diversity of generated 3D objects. The core of the CLAY model includes a multi-resolution variational autoencoder (VAE) and a diffusion transformer (DiT). The VAE is responsible for encoding 3D geometries with different levels of detail into the latent space, while the DiT is responsible for generating these geometries. Unlike many other systems, CLAY…