Researchers at Carnegie Mellon University have unveiled something delightfully geeky: LegoGPT, an AI model that builds Lego structures straight from text prompts.
The study, published last Thursday, explains the mechanics in depth. Armed with a massive dataset of Lego builds constructed by the team with captions, the researchers trained a model similar to ChatGPT — but instead of guessing the next word, it predicts the next brick.
It’s not the first foray into autonomous Lego construction, but the researchers say LegoGPT stands out by generating step-by-step blueprints designed to keep your builds structurally sound. The team’s research, available on GitHub, details how the AI was trained on a dataset of more than 47,000 Lego structures, featuring 28,000 distinct 3D components.
According to the researchers, designs generated by LegoGPT were physically stable 98 percent of the time.
There’s a hefty dose of math and physics behind it all — more than I can personally vouch for — but according to the paper, LegoGPT sticks to the laws of physics, so the results aren’t especially wild. Most of the team’s sample builds were practical pieces: couches, chairs, tables, and similar home designs.
The tool is available for free on GitHub for anyone who wants to explore or experiment.
