Layout Generation refers to the multi-modal problem of generating layouts of a flyer, magazine, a UI interface or even a natural image.

This is a niche area, which is increasingly receiving attention from the community. This awesome-listing is an attempt to bring together works in this space. This list is not complete and looking for your PRs to improve it. Thanks!

• Graphic Design with Large Multimodal Model [Paper]
• Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models [Paper]
• PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation [Paper]
• LayoutFlow: Flow Matching for Layout Generation [Paper]
• COLE: A Hierarchical Generation Framework for Graphic Design [Paper]
• Dolfin: Diffusion Layout Transformers without Autoencoder[Paper]
• LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer [Paper]
• UniLayout: Taming Unified Sequence-to-Sequence Transformers for Graphic Layout Generation [Paper]

• Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation (CVPR 2024) [Paper] [Code]
• Desigen: A Pipeline for Controllable Design Template Generation (CVPR 2024) [Paper] [Code]
• Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation (CVPR 2024) [Paper]
• LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models (ICLR 2024) [Paper] [Code]
• Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints (ICLR 2024) [Paper]
• Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator (AAAI 2024) [Paper] [Code]

• LayoutGPT: Compositional Visual Planning and Generation with Large Language Models (NeurIPS 2023) [Paper] [Code]
• LayoutPrompter: Awaken the Design Ability of Large Language Models (NeurIPS 2023) [Paper] [Code]
• A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptions (ICCV 2023) [Paper] [Code]
• LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models (ICCV 2023) [Paper] [Code]
• DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer (ICCV 2023) [Project page] [Paper] [Code]
• Diffusion-based Document Layout Generation (ICDAR 2023) [Paper]
• Unifying Layout Generation with a Decoupled Diffusion Model (CVPR 2023) [Paper]
• LayoutDM: Discrete Diffusion Model for Controllable Layout Generation (CVPR 2023) [Paper] [Code]
• LayoutDM: Transformer-based Diffusion Model for Layout Generation (CVPR 2023) [Paper]
• PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layout (CVPR 2023) [Paper] [Code]
• Towards Flexible Multi-modal Document Models (CVPR 2023) [Paper] [Code]
• Machine Learning Model to Evaluate the Appropriateness of Layout for Automatic Generation of Graphic Design Works (IMCOM 2023) [Paper]

• BLT: Bidirectional Layout Transformer for Controllable Layout Generation (ECCV 2022) [Paper] [Code]
• Coarse-to-Fine Generative Modeling for Graphic Layouts (AAAI 2022) [Paper]
• Geometry Aligned Variational Transformer for Image-conditioned Layout Generation (MM 2022) [Paper]
• Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs (IJCAI 2022) [Paper]

• Variational Transformer Networks for Layout Generation (CVPR 2021) [Paper]
• LayoutTransformer: Scene Layout Generation with Conceptual and Spatial Diversity (CVPR 2021) [Paper] [Code]
• Constrained Graphic Layout Generation via Latent Optimization (MM 2021) [Paper] [Code]
• LayoutTransformer: Layout Generation and Completion with Self-attention (ICCV 2021) [Paper] [Code]
• CanvasVAE: Learning to Generate Vector Graphic Documents (ICCV 2021) [Paper] [Code]
• RUITE: Refining UI Layout Aesthetics Using Transformer Encoder (IUI 2021) [Paper] [Code]

• Neural Design Network: Graphic Layout Generation with Constraints (ECCV 2020) [Paper]
• Attribute-conditioned Layout GAN for Automatic Graphic Design (T-VCG 2020) [Paper]
• READ: Recursive Autoencoders for Document Layout Generation (CVPRW 2020) [Paper]

• LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks (ICLR 2019, T-PAMI 2021) [ICLR paper] [T-PAMI Paper]
• LayoutVAE: Stochastic Scene Layout Generation From a Label Set (ICCV 2019) [Paper]

• Designscape: Design with interactive layout suggestions (CHI 2015) [Paper]

• Learning Layouts for Single-Page Graphic Designs (TVCG 2014) [Paper]