Shanghai AI Lab's IA-RAG Beats Standard Search on Complex Time-Based Questions by 14%

IA-RAG replaces timestamp lookups with Allen's Interval Algebra, letting RAG systems reason about event overlap, duration, and containment for the first time

·
·
·
Shanghai AI Lab's IA-RAG Beats Standard Search on Complex Time-Based Questions by 14%PRO
  • IA-RAG is a new RAG framework that models facts as time intervals governed by Allen's Interval Algebra, enabling reasoning over event overlap, duration, and containment.
  • Facts are stored as Interval Event Units (IEUs) with start/end timestamps and a fuzzy flag; a Sub-graph Time Tightening mechanism infers missing timestamps from neighboring events.
  • A hierarchical Thematic Forest organizes IEUs into multi-level abstractions (up to 4 layers), enabling coarse-to-fine retrieval that reduces noisy context.
  • At query time, directional Allen-relation traversal walks the graph forward or backward relative to the query's temporal window, avoiding temporally irrelevant neighbors.
  • IA-RAG achieves +10.33% accuracy on ComplexTR over the best baseline and +2.94% on TimeQA; it trails DyG-RAG on TempReason, which favors simple point-in-time lookups.
  • Code is open-source at GitHub, using Qwen2.5-14B-Instruct and BGE-M3 embeddings on 4x A100 GPUs.

Ask a standard RAG system "where did Karl Menger work three years and two months before February 1930?" and it will almost certainly get it wrong. The system finds chunks mentioning Menger near 1930, sees the University of Vienna, and stops there. The correct answer requires working backwards through a precise time interval to land in October 1926, then finding that Menger was at the University of Amsterdam at that point. That kind of arithmetic over overlapping time windows is exactly what current retrieval systems cannot do. A new paper from researchers at East China Normal University and Shanghai AI Lab proposes IA-RAG, a framework that fixes this by treating every fact as a time interval and using formal temporal logic to navigate between them.

Why timestamps alone keep failing

The core problem is that most RAG systems, including graph-based ones like GraphRAG and LightRAG, treat time as a shallow metadata tag. A fact gets a year, maybe a month, and that's it. Real-world facts are not isolated time points; they are intervals with duration, overlap, and containment. This creates three concrete failure modes:

  • Temporal boundary ambiguity: Semantic retrievers struggle to distinguish between states of the same subject across different periods. Queries like "policies before 2008" and "policies after 2008" yield nearly identical embeddings, causing retrieval of temporally irrelevant facts.
  • Missing timestamps: Many real-world facts lack explicit timestamps. Current methods fail to utilize the complementary relationships between events to infer or impute these unknown temporal intervals, leaving a significant portion of the knowledge base temporally unanchored and unsearchable.
  • Topological reasoning gaps: Complex queries often require inferring relationships between multiple events, such as determining if one event occurred during another or if they overlap. Existing RAG systems return disjoint chunks without modeling these interval-based dependencies, forcing LLMs to rely on brittle linguistic inference rather than structured temporal logic.

The algebra behind the fix

IA-RAG is built on Allen's Interval Algebra, a formalism introduced by James Allen in 1983. The calculus defines possible relations between time intervals and provides a composition table that can be used as a basis for reasoning about temporal descriptions of events. The key insight is that any two time intervals can only relate to each other in exactly 13 ways: one can be before, after, during, contains, overlaps, meets, starts, finishes, and so on, plus their inverses. Using this calculus, given facts can be formalized and then used for automatic reasoning. IA-RAG is the first retrieval framework to apply this formalism directly to knowledge retrieval at scale.

Pro article

This story is for Pro members

You've reached the end of the free preview. Upgrade to AlphaSignal Pro to read the full article - and everything else behind the paywall.

Trending
  • No trending articles

Comments

avatar

Next Reads