StableMaterials: Enhancing Diversity in Material Generation via Semi-Supervised Learning
SDEdit for material editing and prompt mixing
Note: Due to the low number of denoising steps of the LCM model, SDEdit is unable to alter significantly the original material. For this experiment, we use the original non-LCM model when editing. Each generation takes 8.5 sec at 1K resolution (base generation (LCM) + refinement (LCM) + edit (non-LCM)). Both the 'original' and the 'edited' image are generated.
| Render | Basecolor | Normal | Height | Roughness | Metallic | |
|---|---|---|---|---|---|---|
|
|
||||||
"Realistic ground rock." → "Stylized ground rock." |
||||||
|
Original |
|
|
|
|
|
|
|
Edited |
|
|
|
|
|
|
|
|
||||||
"Stylized wooden planks." → "Realistic wooden planks." |
||||||
|
Original |
|
|
|
|
|
|
|
Edited |
|
|
|
|
|
|
|
|
||||||
"Moss on stones and roots." → "Stylized moss on stones and roots." |
||||||
|
Original |
 |
|
|
 |
 |
|
|
Edited |
 |
|
|
 |
 |
|
|
|
||||||
"Stylized desert sand." → "Realistic desert sand." |
||||||
|
Original |
 |
|
|
 |
 |
|
|
Edited |
 |
|
|
 |
 |
|
|
|
||||||
"Giraffe fur." → "Cobblestone floor." |
||||||
|
Original |
 |
|
|
 |
 |
|
|
Edited |
 |
|
|
 |
 |
|
|
|
||||||
"Blue coral." → "Parquet." |
||||||
|
Original |
 |
|
|
 |
 |
|
|
Edited |
 |
|
|
 |
 |
|
|
|
||||||
"Volcanic lava." → "Worn leather with deep scratches." |
||||||
|
Original |
 |
|
|
 |
 |
|
|
Edited |
 |
|
|
 |
 |
|
|
|
||||||
"Italian velvet with Renaissance art inspired prints." → "Roman mosaic." |
||||||
|
Original |
 |
|
|
 |
 |
|
|
Edited |
 |
|
|
 |
 |
|