---
title: "LeVLJEPA Beats CLIP and SigLIP Without Negatives or Massive Batches"
subtitle: "A new JEPA-style recipe replaces CLIP's negative pairs with cross-modal prediction, producing sharper patch-level features for downstream VLM and segmentation work."
url: "https://alphasignal.ai/news/levljepa-beats-clip-and-siglip-without-negatives-or-massive-batches"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-07-01T00:00:00.000Z"
updated: "2026-08-22T01:16:36.475Z"
type: "Paper"
topics:
  - "Image"
  - "Llms"
subtopics:
  - "Vision Language"
  - "Vision Language"
upvotes: 252
source_url: "https://arxiv.org/abs/2607.00784"
comments: 0
truncated: true
---

# LeVLJEPA Beats CLIP and SigLIP Without Negatives or Massive Batches

> A new JEPA-style recipe replaces CLIP's negative pairs with cross-modal prediction, producing sharper patch-level features for downstream VLM and segmentation work.

Vision-language pretraining has been stuck on one recipe for years: pull matched image-caption pairs together, push everything else apart, and hope the resulting features are useful downstream. A new paper called [LeVLJEPA](https://arxiv.org/abs/2607.00784) throws that framework out entirely, and the results suggest the field has been optimizing the wrong objective.

The authors introduce what they claim is the first fully non-contrastive end-to-end vision-language pretraining method. It matches CLIP and SigLIP on global tasks like linear probing, and beats them handily on the dense, per-patch features that matter when you plug a vision encoder into a larger system.

## Why the standard recipe is showing its age

CLIP and SigLIP were designed for zero-shot classification, where you compare one pooled image embedding to one caption embedding. That's no longer how these encoders are used. Vision-language encoders increasingly serve as visual backbones in systems where the quality of the image representation matters directly, including visual instruction-tuned models such as LLaVA, dense prediction methods such as DenseCLIP, and language-conditioned robotics systems such as CLIPort and Voltron.

In those systems, the pretrained encoder acts as a frozen feature extractor, and the downstream stack does not consume a single pooled image vector but attends over the full grid of patch tokens. What matters is the quality of the dense, per-token features rather than zero-shot accuracy alone. Contrastive vision-language objectives optimize primarily for cross-modal alignment of a single pooled embedding, which suits zero-shot retrieval and classification while supervising per-token features only as a byproduct.

Vision-only self-supervised learning already moved past contrastive methods. DINO, I-JEPA, and LeJEPA all learn without negatives. Vision-language stubbornly stayed contrastive. LeVLJEPA finally ports that shift across.

## Predict, don't discriminate

The core idea is simple. Instead of asking the model to tell matched pairs apart from unmatched ones, each modality predicts the other's embedding directly. An image embedding tries to predict its caption's embedding. The caption embedding tries to predict the image's. Neither ever sees a negative example.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [LeVLJEPA: End-to-End Vision-Language Pretraining Without Negatives (arXiv)](https://arxiv.org/abs/2607.00784)
- [LeVLJEPA arXiv HTML full paper](https://arxiv.org/html/2607.00784v1)
- [LeVLJEPA-ViT-B-DataComp-200k model on Hugging Face](https://huggingface.co/lukaskuhndkfz/LeVLJEPA-ViT-B-DataComp-200k)
- [LeVLJEPA GitHub repository](https://github.com/mlo-lab/LeVLJEPA)
- [LeVLJEPA project website](https://levljepa.github.io)