Oriol Barbany

Oriol Barbany

/uRiɔl/ /baRbaɲ/

I am a final-year PhD student in the ELLIS PhD program at IRI (CSIC-UPC), supervised by Carme Torras and Adrià Colomé, and in 2024 I visited Amir Zamir's lab at EPFL. I work on machine learning for robotics, computer vision, and multimodal learning.

I am currently interning at Amazon on image generation models. Before that, I interned at Amazon on visual search, vision-language models, and learning to rank, and at Logitech on voice conversion. I hold an MSc in Data Science from EPFL and a BSc in Telecommunications Engineering from UPC.

Publications

OmniDiMM: one model producing 1D, 2D, and 3D modalities

OmniDiMM: Bridging 1D, 2D, and 3D with Any-to-Any Multimodal Modeling

Jason Toskov*, Oriol Barbany*, Rishubh Singh*, Jinya Sakurai, Efe Tarhan, Oğuzhan Fatih Kar, Roman Bachmann, Amir Zadeh, Jesse Allardice, Chuan Li, Carme Torras, Afshin Dehghan, Amir Zamir

NeurIPS 2026

Robot bimanually folding a piece of cloth

BiFold: Bimanual Cloth Folding with Language Guidance

Oriol Barbany, Adrià Colomé, Carme Torras

ICRA 2025

Workshop follow-up: Beyond Static Perception: Integrating Temporal Context into VLMs for Cloth Folding (ICRA 2025 Workshop)

I like this T-shirt.Similar ones? Here's a similarv-neck. Other color? Can I see it in black? Found it in black!Is it what you like? Looks good, thanks! tools Prompt manager LLM vqa(img, "describe") light gray v-neck search(img) search(img, "black")

Leveraging Large Language Models for Multimodal Search

Oriol Barbany, Michael Huang, Xinliang Zhu, Arnab Dhua

CVPR Workshops 2024

noisy label

ProcSim: Proxy-based Confidence for Robust Similarity Learning

Oriol Barbany, Xiaofan Lin, Muhammet Bastan, Arnab Dhua

WACV 2024

Robot manipulating cloth in simulation next to its real-world counterpart

Benchmarking the Sim-to-Real Gap in Cloth Manipulation

David Blanco-Mulero, Oriol Barbany, Gokhan Alcan, Adrià Colomé, Carme Torras, Ville Kyrki

IEEE Robotics and Automation Letters (RA-L) 2024

Reconstructed deformable cloth surface

Deformable Surface Reconstruction via Riemannian Metric Preservation

Oriol Barbany, Adrià Colomé, Carme Torras

Computer Vision and Image Understanding (CVIU) 2024

mobile desktop

Ranker-agnostic Contextual Position Bias Estimation

Oriol Barbany, Vito Bellini, Alexander Buchholz, Giuseppe Di Benedetto, Diego Marco Granziol, Matteo Ruffini, Yannik Stein

arXiv 2021

Hello world FastVC Hello world

FastVC: Fast Voice Conversion with non-parallel data

Oriol Barbany, Milos Cernak

Joint Workshop for the Blizzard Challenge and Voice Conversion Challenge 2020

Hello world Multi-speaker Neural Vocoder speaker

Multi-Speaker Neural Vocoder

Oriol Barbany, Antonio Bonafonte, Santiago Pascual

IberSPEECH 2018