Meta's SAM 3D just picked up a Best Paper Honorable Mention at CVPR, and the model behind the award is a genuine step change for single-image 3D reconstruction. Where prior systems mostly worked on clean, isolated objects floating against white backgrounds, SAM 3D reconstructs the geometry, texture, and pose of objects sitting in messy, cluttered, real-world photos, and it does so with a 5-to-1 human preference win rate over the previous state of the art.

The recognition is significant given the competition. This year's CVPR saw 16,092 papers submitted, and 4,090 were accepted, so a best-paper-tier nod for an in-the-wild 3D reconstruction system says something about where the field thinks the frontier is moving.

The data barrier that has been holding 3D back

Single-image 3D reconstruction has a chicken-and-egg problem. Models like Trellis, Hunyuan3D, and Direct3D have shown strong results on isolated objects, but they fall apart on natural photos where things are occluded, partially out of frame, or surrounded by clutter. The reason is data: natural images paired with accurate 3D ground truth are extremely hard to obtain at scale, because building a 3D mesh from a reference image can take a skilled artist hours.

So everyone trained on synthetic datasets like ShapeNet and Objaverse, where objects are rendered cleanly in isolation. That creates a giant domain gap the moment you point the model at a real photograph.

SAM 3D's authors call this the 3D "data barrier" and their core trick is borrowing the playbook that worked for large language models: cheap, abundant synthetic pretraining followed by carefully curated post-training on real data, all driven by a human-in-the-loop annotation engine.

How the model is built

The architecture is two stages of latent flow matching. The first is a