TransProteus Dataset
TransProteus Dataset for 3D shape and properties of materials liqudis and objects inside transparent vessesls from images", the dataset combine 3D CGI images and real images
Description
The TransProteus dataset new procedurally generated dataset consisting of 50k images of liquids and solid objects inside transparent containers. The image annotations
include 3D models, material properties (color/transparency/roughness...), and segmentation masks for the
vessel and its content. The synthetic (CGI) part of the dataset was procedurally generated using 13k
different objects, 500 different environments (HDRI), and 1450 material textures (PBR) combined with
simulated liquids and procedurally generated vessels. In addition, we supply 104 real-world images of
objects inside transparent vessels with depth maps of both the vessel and its content.
Dataset Generation
The dataset was generated using the Blender 3D software with an emphasis on
generality and diversity. Over 500 high-definition backgrounds (HDRI) were used, providing a wide
variety of natural illumination and environments. In addition, over 13,000 random objects were used for
both the background and the vessel content. Finally, over 1400 material textures (PBRs) were used for
the ground plane. The vessels were procedurally generated with an unlimited number of different curves,
shapes, and materials. Two types of content were generated inside the container. The first type is random
objects taken from the ShapeNet dataset and put inside the vessel. The second content type
was liquids with various properties simulated using the Blender MantaFlow tool with effects such as
splashing, foam, and bubbles. Container shapes and materials for both vessels and content were
procedurally generated. Altogether, this makes the TransProteus dataset one of the most diverse synthetic
datasets in terms of environment, illumination, materials, objects, and setting. In addition, we
created a small dataset containing 104 real-world photos with depth maps of both the vessel and its
content; this set was created using the RealSense depth sensor.
Contact
The LabPics Dataset was created by
the Matter Lab, Alan Aspuru group, feel free to contact us using this
email.
Mirror Dataset Download
Full Dataset Mirror 1
Full Dataset Mirror 2
Sample of Dataset 1
Sample of Dataset 2