Posts by Collection

portfolio

projects

CodCad (2016)

CodCad was an online platform created to teach competitive programming for free. I co-founded CodCad in 2016.

Noic (2016)

Noic is a project that promotes scientific olympiads in Brazil and democratizes access to them. I presided Noic in 2016

publications

Text-image Alignment for Diffusion-based Perception Permalink

Neehar Kondapaneni, Markus Marks, Manuel Knott, Rogério Guimarães & Pietro Perona (CVPR 2024)

We use automatically generated captions to improve the text-image alignment of a diffusion backbone in downstream visual tasks such as semantic segmentation, depth estimation and object detection. Our method also achieves improves the SOTA in both single-domain and cross-domain tasks.

Mice in the Manhattan Maze: Rapid Learning, Flexible Routing and Generalization, With and Without Cortex Permalink

Jieyu Zheng, Rogério Guimarães, Jennifer Hu, Pietro Perona & Markus Meister (CCN 2024)

We designed the “Manhattan Maze,” a reconfigurable navigation task that allows systematic map design over a vast space of possible layouts, to study cognitive flexibility in mice. Naive wildtype mice rapidly learned complex maps within two days and accelerated at learning new ones. Acortical mice, lacking the hippocampus and most of the neocortex, learned more slowly at first but still approached optimal performance, suggesting the cortex is not strictly required for navigating the Manhattan Maze.

Humans and Mice Navigate Mazes Alike. Can AI Beat Them? Permalink

Rogério Guimarães, Alina Zhang, Frank Xiao, Evan Z. Wang, Jieyu Zheng & Pietro Perona (CCN 2025)

We tested human participants on a virtual binary maze game adapted from a prior mouse study and found not only similar performance, but also striking parallels in learning dynamics between humans and mice. We then used this embodied navigation task to compare AI agents with both species, and showed that two canonical agents, a Deep Q-Learning (DQN) model and a Large Language Model (LLM), were outperformed by the biological learners.

Diffusion-Based Action Recognition Generalizes to Untrained Domains Permalink

Rogério Guimarães, Frank Xiao, Pietro Perona & Markus Marks (WACV 2026)

We propose using features generated by a Vision Diffusion Model (VDM), aggregated via a transformer, to achieve human-like action recognition across domain shifts. We find that generalization is enhanced by the use of a model conditioned on earlier timesteps of the diffusion process to highlight semantic information over pixel level details in the extracted features. Our model sets a new state-of-the-art across three generalization benchmarks, bringing machine action recognition closer to human-like robustness.

Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning Permalink

Rogério Guimarães & Pietro Perona (ECCV 2026)

We propose Progressive Seed Pruning (PSP), an inference-time scaling method for diffusion and flow-matching models that scores intermediate denoised estimates and progressively narrows a large pool of candidate seeds, spending compute on promising trajectories instead of resampling a fixed-size pool. Across diffusion and flow-matching backbones, PSP consistently improves reward-guided selection and achieves higher GenEval scores and better human evaluation on prompt-alignment than best-of-N, importance-sampling, and tree-search baselines at matched compute.

talks

teaching

EE 148b: Large Language and Vision Models

Head Teaching Assistant, Caltech, 2024

Teaching Assistant, Caltech, 2023

I was a Teaching Assistant (2023) and later Head Teaching Assistant (2024) for EE 148b: Large Language and Vision Models at Caltech. This course introduces the foundations, design, training, and evaluation of large language models and vision-language models, with an emphasis on modern multimodal systems, reasoning, alignment, and emerging research directions.

EE 148a: Introduction to Deep Learning

Head Teaching Assistant, Caltech, 2026

I was the Head Teaching Assistant for EE 148a: Introduction to Deep Learning at Caltech. It is an introductory course on the foundations and applications of Deep Learning, with a focus on Computer Vision.