Skip to content
Log in
Sponsored Design Multi-Agent AI Systems Using MCP and A2A: Engineer your own Pyt Design Multi-Agent AI Systems Using MCP and A2A: Engineer your own Pyt

3D-Object Perception Transformer (3PT)

Agastya Kalra Tim Salzmann Guy Stoppi Dmitrii Marin Rishav Agarwal Vage Taamazyan M. Bokeloh Stefan Hinterstoißer Anton Boykov Alberto Dall'olio Pravin Dangol Kartik Venkataraman Huaijin Chen
· 1 citation · ⚡ 1 influential · 61 references

TL;DR

3PT surpasses task-specialized models for detection and pose estimation, often achieving double-digit percentage improvements on the diverse BOP-benchmarks, and in some cases outperforming non zero-shot methods.

Semantic Scholar
View source

Similar papers

Conference Jun 2026

Beyond Single Object: Learning 3D Relations with Large Language Models

This work proposes a framework for detailed object-level reasoning across multiple objects with three components: MO3D, an instruction dataset requiring fine-grained multi-object comparison; Multi-3DLLM, using a minimal Patch-Interaction Transformer (PIT) that models inter-/intra-object relationships while preserving l...

K. Ide, Ryousuke Yamada, Yue Qiu et al. · 1 citation · ⚡1
Preprint Aug 2026

MAGneT-3D: Monocular and Domain-Generalizable Temporal 3D Detection

Monocular temporal 3D detection aims to detect objects in 3D, given a monocular video. Query-based 3D detectors unify detection and cross-view association, but their learnable queries fit the spatial distribution of the training data (e.g., field-of-view). We show that this issue is especially severe when these models...

M. Kotb, Johannes Meier, Christoph Reich et al. · 0 citations
Preprint Aug 2026

Probing the 3D Object-Level Understanding of Pre-Trained Detection Transformers

Across a range of detection transformer models, the results show a surprisingly strong and previously unknown ability of 2D DETR models to represent useful information about the 3D properties of objects, despite the complete lack of 3D supervision during model pre-training.

Robin Kim, Colin Samplawski, Benjamin M. Marlin · 0 citations
Preprint Aug 2026

Map-Det3D: Metric Feed-Forward 3D Reconstruction Prior for Multi-view 3D Object Detection from Streaming Inputs

Map-Det3D is an online multi-view 3D object detection model that brings detection directly into a 3D space reconstructed from RGB, suggesting that training reconstruction priors for detection is a practical route to stable metric 3D detection from monocular video.

Yung-Hsu Yang, Luigi Piccinelli, S. R. Bulò et al. · 1 citation
Preprint Aug 2026

Foundational feature fusion for conditional flow matching in 6D pose estimation

This work presents FunFlow6D, a novel flow matching-based formulation that leverages features from geometric and appearance foundation models for pose estimation, eliminating the need for task-specific encoders supervised on object-scene overlap and reducing supervision requirements and memory overhead.

Amir Hamza, Davide Boscaini, Fabio Poiesi · 0 citations
Conference Aug 2026

MonoYOLO: Monocular 3D Detection via Cross-Modal Feature Fusion

In intelligent transportation, roadside perception systems act as city’s eyes. However, monocular camera-based 3D object detection remains challenging, as inferring 3D geometry from 2D images is ill-posed, especially under occlusion, scale variation, and adverse weather. To address this, we propose MonoYOLO, featuring...

Rong-Hui Liang, Juan Du · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.