Computer Vision

Separating the" Chirp" from the" Chat": Self-supervised Visual Grounding of Sound and Language

Mark Hamilton, Andrew Zisserman, John R Hershey, William T Freeman
IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024
Paper (pdf)

Wonderjourney: Going from anywhere to everywhere

Hong-Xing Yu, Haoyi Duan, Junhwa Hur, Kyle Sargent, Michael Rubinstein, William T Freeman, Forrester Cole, Deqing Sun, Noah Snavely, Jiajun Wu, Charles Herrmann
IEEE/CVF Conference on Computer Vision and Pattern Recognition 2024
Paper (pdf)

FeatUp: A Model-Agnostic Framework for Features at Any Resolution

Stephanie Fu, Mark Hamilton, Laura Brandt, Axel Feldman, Zhoutong Zhang, William T. Freeman
International Conference on Learning Representations (ICLR) 2024
Paper (pdf)

Diffusion with forward models: Solving stochastic inverse problems without direct supervision

Ayush Tewari, Tianwei Yin, George Cazenavette, Semon Rezchikov, Josh Tenenbaum, Frédo Durand, Bill Freeman, Vincent Sitzmann
Advances in Neural Information Processing Systems 2023
Paper (pdf)

Evaluating Peripheral Vision as an Input Transformation to Understand Object Detection Model Behavior

Anne Harrington, Vasha DuTell, Mark Hamilton, Ayush Tewari, Simon Stent, William T Freeman, Ruth Rosenholtz
NeuRIPS 2023 Workshop on Gaze Meets ML
Paper (pdf)

StatTexNet: Evaluating the Importance of Statistical Parameters for Pyramid-Based Texture and Peripheral Vision Models

Christian Koevesdi, Vasha DuTell, Anne Harrington, Mark Hamilton, William T Freeman, Ruth Rosenholtz
NeuRIPS 2023 Workshop on Gaze Meets ML
Paper (pdf)

COCO-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery

Anne Harrington, Vasha DuTell, Mark Hamilton, Ayush Tewari, Simon Stent, William T Freeman, Ruth Rosenholtz
International Conference on Learning Representations 2024
Paper (pdf)

Evaluating Pyramid-Based Image Statistics Using Contrastive Learning

Vasha DuTell, William Freeman, Ruth Rosenholtz
Journal of Vision

Metaclue: Towards comprehensive visual metaphors research

Arjun R Akula, Brendan Driscoll, Pradyumna Narayana, Soravit Changpinyo, Zhiwei Jia, Suyash Damle, Garima Pruthi, Sugato Basu, Leonidas Guibas, William T Freeman, Yuanzhen Li, Varun Jampani
IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023

Can Shadows Reveal Biometric Information?

Safa C Medin, Amir Weiss, Frédo Durand, William T Freeman, Gregory W Wornell
Winter Conference on Applications of Computer Vision (WACV) 2023
Paper (pdf)

Associating objects and their effects in video through coordination games

Erika Lu, Forrester Cole, Weidi Xie, Tali Dekel, Bill Freeman, Andrew Zisserman, Michael Rubinstein
Advances in Neural Information Processing Systems 2022
Paper (pdf)

Structure and motion from casual videos

Zhoutong Zhang, Forrester Cole, Zhengqi Li, Michael Rubinstein, Noah Snavely, William T Freeman
European Conference on Computer Vision (ECCV) 2022
Paper (pdf)

Disentangling architecture and training for optical flow

Deqing Sun, Charles Herrmann, Fitsum Reda, Michael Rubinstein, David J Fleet, William T Freeman
European Conference on Computer Vision (ECCV) 2022
Paper (pdf)

Maskgit: Masked generative image transformer

Huiwen Chang, Han Zhang, Lu Jiang, Ce Liu, William T Freeman
Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Paper (pdf)

Unsupervised semantic segmentation by distilling feature correspondences

Mark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely, William T Freeman
International Conference on Learning Representations (ICLR) 2022
Paper (pdf)

Nerfactor: Neural factorization of shape and reflectance under an unknown illumination

Xiuming Zhang, Pratul P Srinivasan, Boyang Deng, Paul Debevec, William T Freeman, Jonathan T Barron
ACM Transactions on Graphics (TOG), 2021
Paper (pdf)

Light field networks: Neural scene representations with single-evaluation rendering

Vincent Sitzmann, Semon Rezchikov, Bill Freeman, Josh Tenenbaum, Fredo Durand
Advances in Neural Information Processing Systems (NeurIPS) 2021
Paper (pdf)

Explaining in style: Training a gan to explain a classifier in stylespace

Oran Lang, Yossi Gandelsman, Michal Yarom, Yoav Wald, Gal Elidan, Avinatan Hassidim, William T Freeman, Phillip Isola, Amir Globerson, Michal Irani, Inbar Mosseri
International Conference on Computer Vision (ICCV) 2021
Paper (pdf)

Thundr: Transformer-based 3d human reconstruction with markers

Mihai Zanfir, Andrei Zanfir, Eduard Gabriel Bazavan, William T Freeman, Rahul Sukthankar, Cristian Sminchisescu
International Conference on Computer Vision (ICCV) 2021
Paper (pdf)

What you can learn by staring at a blank wall

Prafull Sharma, Miika Aittala, Yoav Y Schechner, Antonio Torralba, Gregory W Wornell, William T Freeman, Frédo Durand
International Conference on Computer Vision (ICCV) 2021
Paper (pdf)

MosAIc: Finding Artistic Connections across Culture with Conditional Image Retrieval

Mark Hamilton, Stephanie Fu, Mindren Lu, Johnny Bui, Darius Bopp, Zhenbang Chen, Felix Tran, Margaret Wang, Marina Rogers, Lei Zhang, Chris Hoder, William T Freeman
NeurIPS 2020 Competition and Demonstration Track
Paper (pdf)

Consistent depth of moving objects in video

Zhoutong Zhang, Forrester Cole, Richard Tucker, William T Freeman, Tali Dekel
ACM Transactions on Graphics (TOG), 2021
Paper (pdf)

Autoflow: Learning a better training set for optical flow

Deqing Sun, Daniel Vlasic, Charles Herrmann, Varun Jampani, Michael Krainin, Huiwen Chang, Ramin Zabih, William T Freeman, Ce Liu
Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Paper (pdf)

Lasr: Learning articulated shape reconstruction from a monocular video

Gengshan Yang, Deqing Sun, Varun Jampani, Daniel Vlasic, Forrester Cole, Huiwen Chang, Deva Ramanan, William T Freeman, Ce Liu
Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Paper (pdf)

Neural Descent for Visual 3D Human Pose and Shape

Andrei Zanfir, Eduard Gabriel Bazavan, Mihai Zanfir, William T Freeman, Rahul Sukthankar, Cristian Sminchisescu
Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Paper (pdf)

Omnimatte: associating objects and their effects in video

Erika Lu, Forrester Cole, Tali Dekel, Andrew Zisserman, William T Freeman, Michael Rubinstein
Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Paper (pdf)

Multi-plane program induction with 3d box priors

Yikai Li, Jiayuan Mao, Xiuming Zhang, Bill Freeman, Josh Tenenbaum, Noah Snavely, Jiajun Wu
Advances in Neural Information Processing Systems (NeurIPS) 2020
Paper (pdf)

Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows

Andrei Zanfir, Eduard Gabriel Bazavan, Hongyi Xu, Bill Freeman, Rahul Sukthankar, Cristian Sminchisescu
European Conference on Computer Vision (ECCV), 2020
Paper (pdf)

GHUM & GHUML: Generative 3D Human Shape and Articulated Pose Models

Hongyi Xu, Eduard Gabriel Bazavan, Andrei Zanfir, William T Freeman, Rahul Sukthankar, Cristian Sminchisescu
Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Paper (pdf)  :  Project Repo

SpeedNet: Learning the Speediness in Videos

Sagie Benaim, Ariel Ephrat, Oran Lang, Inbar Mosseri, William T Freeman, Michael Rubinstein, Michal Irani, Tali Dekel
Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Paper (pdf)

Perspective Plane Program Induction From a Single Image

Yikai Li, Jiayuan Mao, Xiuming Zhang, William T Freeman, Joshua B Tenenbaum, Jiajun Wu
Computer Vision and Pattern Recognition(CVPR), 2020
Paper (pdf)

Semantic Pyramid for Image Generation

Assaf Shocher, Yossi Gandelsman, Inbar Mosseri, Michal Yarom, Michal Irani, William T Freeman, Tali Dekel
Computer Vision and Pattern Recognition (CVPR), 2020
Paper (pdf)  :  Project Page

MannequinChallenge: Learning the Depths of Moving People by Watching Frozen People

Zhengqi Li, Tali Dekel, Forrester Cole, Richard Tucker, Noah Snavely, Ce Liu, William T Freeman
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020
Paper (pdf)

Visual Deprojection: Probabilistic Recovery of Collapsed Dimensions

Guha Balakrishnan, Adrian V. Dalca, Amy Zhao, John V. Guttag, Fredo Durand, and William T. Freeman
International Conference on Computer Vision (ICCV) 2019
Paper (pdf)

Boundless: Generative adversarial networks for image extension

Piotr Teterwak, Aaron Sarna, Dilip Krishnan, Aaron Maschinot, David Belanger, Ce Liu, William T Freeman
IEEE International Conference on Computer Vision(ICCV), 2019
Paper (pdf)  :  Project Page

Learning shape templates with structured implicit functions

Kyle Genova, Forrester Cole, Daniel Vlasic, Aaron Sarna, William T Freeman, Thomas Funkhouser
IEEE International Conference on Computer Vision(ICCV), 2019
Paper (pdf)

Program-Guided Image Manipulators

Jiayuan Mao, Xiuming Zhang, Yikai Li, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu
IEEE International Conference on Computer Vision (ICCV), 2019
Paper (pdf)  :  Project page

Using unknown occluders to recover hidden scenes

Adam B Yedidia, Manel Baradad, Christos Thrampoulidis, William T Freeman, Gregory W Wornell
IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2019
Paper (pdf)

Reasoning about physical interactions with object-centric models

Michael Janner, Sergey Levine, William T Freeman, Joshua B Tenenbaum, Chelsea Finn, Jiajun Wu
International Conference on Learning Representations (ICLR), 2019
Paper (pdf)  :  Project Page

Deep Audio Priors Emerge From Harmonic Convolutional Networks

Zhoutong Zhang, Yunyun Wang, Chuang Gan, Jiajun Wu, Joshua B Tenenbaum, Antonio Torralba, William T Freeman
International Conference on Learning Representations (ICLR), 2019
Paper (pdf)  :  Project Page

Learning the Depths of Moving People by Watching Frozen People

Zhengqi Li, Tali Dekel, Forrester Cole, Richard Tucker, Noah Snavely, Ce Liu, William T Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019

Best Paper Honorable Mention.

Paper (pdf)  :  Project page

Speech2Face: Learning the Face Behind a Voice

Tae-Hyun Oh, Tali Dekel, Changil Kim, Inbar Mosseri, William T Freeman, Michael Rubinstein, Wojciech Matusik
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
Paper (pdf)  :  Project page

Using Unknown Occluders to Recover Hidden Scenes

Adam B Yedidia, Manel Baradad, Christos Thrampoulidis, William T Freeman, Gregory W Wornell
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
Paper (pdf)

Visual Dynamics: Stochastic Future Generation via Layered Cross Convolutional Networks

Tianfan Xue, Jiajun Wu, Katherine L. Bouman, and William T. Freeman
IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2019
Paper (pdf)  :  Project page

Learning to Infer and Execute 3D Shape Programs

Yonglong Tian, Andrew Luo, Xingyuan Sun, Kevin Ellis, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu
International Conference on Learning Representations (ICLR), 2019
Paper (pdf)  :  Project page

Reasoning About Physical Interactions with Object-Centric Models

Michael Janner, Sergey Levine, William T. Freeman, Joshua T. Tenenbaum, Chelsea Finn, and Jiajun Wu
International Conference on Learning Representations (ICLR), 2019
Paper (pdf)  :  Project page

GAN Dissection: Visualizing and Understanding Generative Adversarial Networks

David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B. Tenenbaum, William T. Freeman, Antonio Torralba
International Conference on Learning Representations (ICLR), 2019
Paper (pdf)  :  Project page

Unsupervised Discovery of Parts, Structure, and Dynamics

Zhenjia Xu, Zhijian Liu, Chen Sun, Kevin Murphy, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu
International Conference on Learning Representations (ICLR), 2019
Paper (pdf)  :  Project page

Learning to Describe Scenes with Programs

Yunchao Liu, Zheng Wu, Daniel Ritchie, William T. Freeman, Joshua B. Tenenbaum, Jiajun Wu
International Conference on Learning Representations (ICLR), 2019
Paper (pdf)

Video Enhancement with Task-Oriented Flow

Tianfan Xue, Baian Chen, Jiajun Wu, Donglai Wei, William T Freeman
International Journal of Computer Vision (IJCV), 2019
Paper (pdf)  :  Project page

Learning to Reconstruct Shapes from Unseen Classes

Xiuming Zhang, Zhoutong Zhang, Chengkai Zhang, William T. Freeman, Joshua B. Tenenbaum, and Jiajun Wu
Neural Information Processing Systems (NeurIPS), 2018. Oral presentation.
Paper (pdf)  :  Project page

3D-Aware Scene Manipulation via Inverse Graphics

Shunyu Yao, Tzu-Ming Harry Hsu, Jun-Yan Zhu, Jiajun Wu, Antonio Torralba, William T. Freeman, and Joshua B. Tenenbaum
Neural Information Processing Systems (NeurIPS), 2018
Paper (pdf)  :  Project page

Learning to Exploit Stability for 3D Scene Parsing

Yilun Du, Zhijian Liu, Hector Basevi, Ales Leonardis, William T. Freeman, Joshua B. Tenenbaum, and Jiajun Wu
Neural Information Processing Systems (NeurIPS), 2018
Paper (pdf)  :  Project page

Visual Object Networks: Image Generation with Disentangled 3D Representations

Jun-Yan Zhu, Zhoutong Zhang, Chengkai Zhang, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum, and William T. Freeman
Neural Information Processing Systems (NeurIPS), 2018
Paper (pdf)  :  Project page

ShadowCam: Real-Time Detection of Moving Obstacles Behind A Corner For Autonomous Vehicles

Felix Naser, Igor Gilitschenski, Guy Rosman, Alexander Amini, Fredo Durand, Antonio Torralba, Gregory W Wornell, William T Freeman, Sertac Karaman, Daniela Rus
International Conference on Intelligent Transportation Systems (ITSC), 2018

MoSculp: Interactive Visualization of Shape and Time

Xiuming Zhang, Tali Dekel, Tianfan Xue, Andrew Owens, Qiurui He, Jiajun Wu, Stefanie Mueller, and William T. Freeman
ACM Symposium on User Interface Software and Technology (UIST), 2018
Paper (pdf)  :  Project page

3D Shape Perception from Monocular Vision, Touch, and Shape Priors

Shaoxiong Wang, Jiajun Wu, Xingyuan Sun, Wenzhen Yuan, William T. Freeman, Joshua B. Tenenbaum, and Edward H. Adelson
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018
Paper (pdf)  :  Project page

Learning Shape Priors for Single-View 3D Completion and Reconstruction

Jiajun Wu, Chengkai Zhang, Xiuming Zhang, Zhoutong Zhang, William T. Freeman, and Joshua B. Tenenbaum
European Conference on Computer Vision (ECCV), 2018
Paper (pdf)  :  Project page

Physical Primitive Decomposition

Zhijian Liu, William T. Freeman, Joshua B. Tenenbaum, and Jiajun Wu
European Conference on Computer Vision (ECCV), 2018
Paper (pdf)  :  Project page

Seeing Tree Structure from Vibration

Tianfan Xue, Jiajun Wu, Zhoutong Zhang, Chengkai Zhang, Joshua B. Tenenbaum, and William T. Freeman
European Conference on Computer Vision (ECCV), 2018
Paper (pdf)  :  Project page

Medical Image Imputation from Image Collections

Adrian V Dalca, Katherine L Bouman, William T Freeman, Natalia S Rost, Mert R Sabuncu, Polina Golland
IEEE Transactions on Medical Imaging
Paper (pdf)

Best-buddies similarity—robust template matching using mutual nearest neighbors

Shaul Oron, Tali Dekel, Tianfan Xue, William T Freeman, Shai Avidan
IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2018
Paper (pdf)

Unsupervised Training for 3D Morphable Model Regression

Kyle Genova, Forrester Cole, Aaron Maschinot, Aaron Sarna, Daniel Vlasic, William T Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Paper (pdf)

Inferring Light Fields from Shadows

Manel Baradad, Vickie Ye, Adam B Yedidia, Frédo Durand, William T Freeman, Gregory W Wornell, Antonio Torralba
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. Spotlight presentation.
Paper (pdf)

Learning and Using the Arrow of Time

Donglai Wei, Joseph Lim, Andrew Zisserman, William T Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Paper (pdf)

Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling

Xingyuan Sun, Jiajun Wu, Xiuming Zhang, Zhoutong Zhang, Chengkai Zhang, Tianfan Xue, Joshua B. Tenenbaum, and William T. Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Paper (pdf)  :  Project page

Smart, Sparse Contours to Represent and Edit Images

T Dekel, C Gan, D Krishnan, C Liu, WT Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
Paper (pdf)

Exploiting Occlusion in Non-Line-of-Sight Active Imaging

Christos Thrampoulidis, Gal Shulkind, Feihu Xu, William T Freeman, Jeffrey Shapiro, Antonio Torralba, Franco Wong, Gregory Wornell
IEEE Transactions on Computational Imaging, 2018
Paper (pdf)

Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separation

Ariel Ephrat, Inbar Mosseri, Oran Lang, Tali Dekel, Kevin Wilson, Avinatan Hassidim, William T Freeman, Michael Rubinstein
SIGGRAPH, 2018
Paper (pdf)

Cognitive Load Estimation in the Wild

Lex Fridman, Bryan Reimer, Bruce Mehler, William T Freeman
CHI Conference on Human Factors in Computing Systems, 2018
Paper (pdf)

3D Interpreter Networks for Viewer-Centered Wireframe Modeling

Jiajun Wu, Tianfan Xue, Joseph J Lim, Yuandong Tian, Joshua B Tenenbaum, Antonio Torralba, William T Freeman
International Journal of Computer Vision (IJCV), 2018
Paper (pdf)  :  Project page

Learning Sight from Sound: Ambient Sound Provides Supervision for Visual Learning

Andrew Owens, Jiajun Wu, Josh H McDermott, William T Freeman, Antonio Torralba
Interactional Journal of Computer Vision (IJCV), 2018
Paper (pdf)  :  Project page

Learning to See Physics via Visual De-animation

Jiajun Wu, Erika Lu, Pushmeet Kohli, William T. Freeman, and Joshua B. Tenenbaum
Neural Information Processing Systems (NIPS), 2017. Spotlight presentation.
Paper (pdf)  :  Project page

Shape and Material from Sound

Zhoutong Zhang, Qiujia Li, Zhengjia Huang, Jiajun Wu, Joshua B. Tenenbaum, and William T. Freeman
Neural Information Processing Systems (NIPS), 2017. Spotlight presentation.
Paper (pdf)  :  Project page

Marrnet: 3D shape reconstruction via 2.5D sketches

Jiajun Wu, Yifan Wang, Tianfan Xue, Xingyuan Sun, William T Freeman, Joshua B Tenenbaum
Neural Information Processing Systems (NIPS), 2017
Paper (pdf)  :  Project page

Turning Corners into Cameras: Principles and Methods

Katherine L Bouman, Vickie Ye, Adam B Yedidia, Frédo Durand, Gregory W Wornell, Antonio Torralba, William T Freeman
International Conference on Computer Vision (ICCV), 2017
Paper (pdf)  :  Project page

Generative modeling of audible shapes for object perception

Zhoutong Zhang, Jiajun Wu, Qiujia Li, Zhengjia Huang, James Traer, Josh H McDermott, Joshua B Tenenbaum, William T Freeman
International Conference on Computer Vision (ICCV), 2017
Paper (pdf)  :  Project page

Motion microscopy for visualizing and quantifying small motions

Neal Wadhwa, Justin G Chen, Jonathan B Sellon, Donglai Wei, Michael Rubinstein, Roozbeh Ghaffari, Dennis M Freeman, Oral Büyüköztürk, Pai Wang, Sijie Sun, Sung Hoon Kang, Katia Bertoldi, Frédo Durand, William T Freeman
Proceedings of the National Academy of Sciences (PNAS), 2017
Paper (pdf)  :  Project page

Guest Editorial Special Issue on Extreme Imaging

WT Freeman, A Savakis, Y Schechner, N Snavely, W Heidrich
IEEE Transactions on Computational Imaging 3 (3), 382-383
Paper (pdf)

Synthesizing normalized faces from facial identity features

Forrester Cole, David Belanger, Dilip Krishnan, Aaron Sarna, Inbar Mosseri, William T Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
Paper (pdf)  :  synced review

On the Effectiveness of Visible Watermarks

T Dekel, M Rubinstein, C Liu, WT Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
Paper (pdf)  :  Google Research blog post

Eulerian Video Magnification and Analysis

Neal Wadhwa, Hao-Yu Wu, Abe Davis, Michael Rubinstein, Eugene Shih, Gautham J. Mysore, Justin G. Chen, Oral Buyukozturk, John V. Guttag, William T. Freeman, Frédo Durand
Communications of the ACM, Vol. 60 No. 1, Pages 87-95, January 2017
Paper (pdf)

Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling

Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, Joshua B. Tenenbaum
Neural Information Processing Systems (NIPS), 2016
Paper (pdf)  :  Project page

Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks

Tianfan Xue, Jiajun Wu, Katherine L. Bouman, William T. Freeman
Neural Information Processing Systems (NIPS), 2016. Oral presentation.
Paper (pdf)  :  Project page

Video Camera–Based Vibration Measurement for Civil Infrastructure Applications

Justin G Chen, Abe Davis, Neal Wadhwa, Frédo Durand, William T Freeman, Oral Büyüköztürk
Journal of Infrastructure Systems, Vol 3 (2)
Paper (pdf)

Ambient Sound Provides Supervision for Visual Learning

Andrew Owens, Jiajun Wu, Josh McDermott, William Freeman, Antonio Torralba.
European Conference on Computer Vision (ECCV), 2016. Oral presentation.
Paper (pdf)  :  Project page

Single Image 3D Interpreter Network

Jiajun Wu, Tianfan Xue, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman
European Conference on Computer Vision (ECCV), 2016. Oral presentation.
Paper (pdf)  :  Project page

Physics 101: Learning Physical Object Properties from Unlabeled Videos

Jiajun Wu, Joseph J. Lim, Hongyi Zhang, Joshua B. Tenenbaum, and William T. Freeman
British Machine Vision Conference (BMVC), 2016.
Paper (pdf)  :  Project page

A Comparative Evaluation of Approximate Probabilistic Simulation and Deep Neural Networks as Accounts of Human Physical Scene Understanding

Renqiao Zhang, Jiajun Wu, Chengkai Zhang, William T Freeman, Joshua B Tenenbaum
Annual Meeting of the Cognitive Science Society (CogSci), 2016. Oral presentation.
Paper (pdf)  :  Project page

Visually Indicated Sounds

A Owens, P Isola, J McDermott, A Torralba, EH Adelson, WT Freeman
Computer Vision and Pattern Recognition (CVPR) 2016
Paper (pdf)  :  project page

Computational Imaging for VLBI Image Reconstruction

Katherine L. Bouman, MD Johnson, Daniel Zoran, Vincent L. Fish, Sheperd S. Doeleman, William T. Freeman
Computer Vision and Pattern Recognition (CVPR) 2016
Paper (pdf)  :  VLBI reconstruction dataset

Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning

Jiajun Wu, Ilker Yildirim, Joseph J. Lim, William T. Freeman, Joshua B. Tenenbaum
Neural Information Processing Systems, 127-135 (NIPS), 2015
Paper (pdf)  :  Project page

A computational approach for obstruction-free photography

Tianfan Xue, Michael Rubinstein, Ce Liu, William T. Freeman
ACM Transactions on Graphics (TOG) 34 (4), (SIGGRAPH), 2015
Paper (pdf)

Modal identification of simple structures with high-speed video using motion magnification

Justin G Chen, Neal Wadhwa, YJ Cha, Fredo Durand, William T Freeman, Oral Buyukozturk
Journal of Sound and Vibration vol 345, pages 58-71, 2015
Paper (pdf)

Best-Buddies Similarity for Robust Template Matching

Tali Dekel, Shaul Oron, Michael Rubinstein, Shai Avidan, William T. Freeman
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
Paper (pdf)

The Aperture Problem for Refractive Motion

Tianfan Xue, Hossein Mobahi, Fredo Durand, William T. Freeman
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
Paper (pdf)

Video Magnification in Presence of Large Motions

Mohamed Elgharib, Mohamed Hefeeda, Fredo Durand, William T. Freeman
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
Paper (pdf)

Visual Vibrometry: Estimating Material Properties from Small Motions in Video

Abe Davis, Katherine L. Bouman, Justin G. Chen, Michael Rubinstein, Fredo Durand, William T. Freeman
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
Paper (pdf)

Developments with Motion Magnification for Structural Modal Identification Through Camera Video

Justin G Chen, Neal Wadhwa, Fredo Durand, William T Freeman, Oral Buyukozturk
Dynamics of Civil Structures, Volume 2, pages 49-57, 2015
Paper (pdf)

A World of Movement

Fredo Durand, William T. Freeman, Michael Rubinstein
Scientific American, Volume 312, Number 1, January 2015
Paper (pdf)  :  videos

Refraction Wiggles for Measuring Fluid Depth and Velocity from Video

Tianfan Xue, Michael Rubinstein , Neal Wadhwa , Anat Levin, Frédo Durand, William T. Freeman
European Conference on Computer Vision (ECCV), 2014
Paper (pdf)  :  Project page

The Visual Microphone: Passive Recovery of Sound from Video

Abe Davis, Michael Rubinstein, Neal Wadhwa, Gautham Mysore, Fredo Durand, William T. Freeman
ACM Transactions on Graphics, Volume 33, Number 4 (Proc. SIGGRAPH), 2014.
Paper (pdf)  :  Project web page  :  Wait, Wait Don't Tell Me segment (starts at minute 3:28)  :  Chinese television (CCTV)

Camouflaging an Object from Many Viewpoints

Andrew Owens, Connelly Barnes, Alex Flint, Hanumant Singh, William T. Freeman
IEEE Computer Vision and Pattern Recognition (CVPR), 2014
Paper (pdf)  :  Project page

Seeing the Arrow of Time

Lyndsey Pickup, Zheng Pan, Donglai Wei, Yichang Shih, Andrew Zisserman, William T. Freeman, Bernhard Schoelkopf
IEEE Computer Vision and Pattern Recognition (CVPR), 2014
Paper (pdf)  :  Project page (and data)

A Compositional Model for Low-Dimensional Image Set Representation

Hossein Mobahi, Ce Liu, and William T. Freeman
IEEE Computer Vision and Pattern Recognition (CVPR), 2014
Paper (pdf)

Accidental Pinhole and Pinspeck Cameras

Antonio Torralba and William T. Freeman
International Journal of Computer Vision

 110 (2), 92-112

Paper (pdf)  :  Project page

Riesz Pyramids for Fast Phase-Based Video Magnification

Neal Wadhwa, Michael Rubinstein, Frédo Durand, William T. Freeman
International Conference on Computational Photography (ICCP), 2014.
Paper (pdf)  :  Project page

Structural modal identification through high speed camera video

Justin G Chen, Neal Wadhwa, Young-Jin Cha, Frédo Durand, William T. Freeman, Oral Buyukozturk
Topics in Modal Analysis I, Volume 7, pages 191-197, Springer International Publishing, 2014.
Paper (pdf)

Estimating the Material Properties of Fabric from Video

Katherine L. Bouman, Bei Xiao, Peter Battaglia, William T. Freeman
2013 IEEE International Conference on Computer Vision (ICCV)
Paper (pdf)  :  Project page

Group Norm for Learning Structured SVMs with Unstructured Latent Variables

Daowen Chen, Dhruv Batra, William T. Freeman
2013 IEEE International Conference on Computer Vision (ICCV)
Paper (pdf)

Shape Anchors for Data-Driven Multi-view Reconstruction

Andrew Owens, Jianxiong Xiao, Antonio Torralba, William Freeman
International Conference on Computer Vision (ICCV), 2013
Paper (pdf)  :  Project page

Towards Longer Long-Range Motion Trajectories

Michael Rubinstein, Ce Liu, William T. Freeman
British Machine Vision Conference (BMVC) 2012
Paper (pdf)

Annotation Propagation in Large Image Databases via Dense Image Correspondence

Michael Rubinstein, Ce Liu, William T. Freeman
European Conference on Computer Vision (ECCV), October 2012
Paper (pdf)

Patch Complexity, Finite Pixel Correlations and Optimal Denoising

Anat Levin, Boaz Nadler, Fredo Durand, William T. Freeman
European Conference on Computer Vision (ECCV), October 2012
Paper (pdf)

Shapecollage: Occlusion-Aware, Example-Based Shape Interpretation

Forrester Cole, Phillip Isola, William T. Freeman, Fredo Durand, Edward Adelson
European Conference on Computer Vision (ECCV), October 2012
Paper (pdf)  :  Project website

Accidental pinhole and pinspeck cameras: revealing the scene outside the picture

Antonio Torralba and William T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2012
Paper (pdf)  :  Project website

Laser Speckle Photography for Surface Tampering Detection

YiChang Shih, Abe Davis, Sam Hasinoff, Fredo Durand, William T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2012
Paper (pdf)  :  Project website

Diffuse Reflectance Imaging with Astronomical Applications

Sam Hasinoff, Anat Levin, Philip Goode and William T. Freeman
IEEE Intl. Conf. on Computer Vision (ICCV), 2011
Paper (pdf)  :  Project website

Evaluation of Image Features Using a Photorealistic Virtual World

Biliana Kaneva, Antonio Torralba, William Freeman
IEEE Intl. Conf. on Computer Vision (ICCV), 2011
Paper (pdf)  :  Project website  :  Video

Blur Kernel Estimation Using the Radon Transform

Taeg Sang Cho, Sylvain Paris, William Freeman, Berthold Horn
Proc. 23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011
Paper (pdf)

Efficient Marginal Likelihood Optimization in Blind Deconvolution

A. Levin, Y. Weiss, F. Durand, and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition, June 2011
Paper (pdf)

Motion Denoising with Application to Time-lapse Photography

Michael Rubinstein, Ce Liu, Peter Sand, Fredo Durand, William Freeman
Proc. 23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011
Paper (pdf)  :  Project website

Where computer vision needs help from computer science

W. T. Freeman
ACM-SIAM Symposium on Discrete Algorithms, January, 2011
Paper (pdf)

Infinite Images: Creating and Exploring a Large Photorealistic Virtual Space

Biliana Kaneva, Josef Sivic, Antonio Torralba, Shai Avidan and William T. Freeman
Proceedings of the IEEE, volume 98, issue 8, pages 1391 - 1407, 2010
Paper (pdf)  :  Project website

Matching and Predicting Street Level Images

Biliana Kaneva, Josef Sivic, Antonio Torralba, Shai Avidan and William T. Freeman
Workshop for Vision on Cognitive Tasks, European Conf. on Computer Vision (ECCV) 2010
Paper (pdf)

Motion blur removal with orthogonal parabolic exposures

Taeg Sang Cho, Anat Levin, Fredo Durand, and William T. Freeman
IEEE Intl. Conf. on Computational Photography (ICCP), 2010
Paper (pdf)  :  Project website

The Patch Transform

T. S. Cho, S. Avidan, and W. T. Freeman
IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 32, issue 8, pages 1489 - 1501, August, 2010
Paper (pdf)

A Content-Aware Image Prior

T. S. Cho, N. Joshi, C. L. Zitnick, S. B. Kang, R. Szeliski and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010
Paper (pdf)  :  Project website

A Probabilistic Image Jigsaw Puzzle Solver

T. S. Cho, S. Avidan and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010
Paper (pdf)  :  Project website

Analyzing Spatially-varying Blur

A. Chakrabarti, Todd Zickler and William T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010
Paper (pdf)  :  Source code

Latent Hierarchical Structural Learning for Object Detection

L. Zhu, Y. Chen, A. Torralba, A. Yuille and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010
Paper (pdf)

Part and Appearance Sharing: Recursive Compositional Models for Multi-View Multi-Object Detection

L. Zhu, Y. Chen, A. Torralba, W. T. Freeman, and A. Yuille
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010
Paper (pdf)

Using the Forest to See the Trees: Exploiting Context for Visual Object Detection and Localization

Antonio Torralba, Kevin Murphy and William T. Freeman
Communications of the ACM, March 2010, Vol. 53, No. 3
Paper (pdf)

Ground-truth dataset and baseline evaluations for intrinsic image algorithms

R. Grosse, M.K. Johnson, E.H. Adelson, and W.T. Freeman
International Conference on Computer Vision, 2009
Paper (pdf)  :  Project website

Nonparametric Bayesian Texture Learning and Synthesis

Long Zhu, Yuanhao Chen, William Freeman, Antonio Torralba
Neural Information Processing Systems (NIPS) 2009
Paper (pdf)

Segmenting Scenes by Matching Image Composites

B. C. Russell, A. A. Efros, J. Sivic, W. T. Freeman, and A. Zisserman
Neural Information Processing Systems (NIPS) 2009
Paper (pdf)

Informative Sensing of Natural Images

Hyun Sung Chang, Yair Weiss, William T. Freeman
IEEE Int. Conf. Image Processing, Egypt, Nov. 2009
Paper (pdf)

Understanding and evaluating blind deconvolution algorithms

A. Levin, Y. Weiss, F. Durand, and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2009

Best paper award runner up

Paper (pdf)

LabelMe: a Database and Web-based Tool for Image Annotation

B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman
International Journal of Computer Vision, 77(1-3):157-173, 2008
Paper (pdf)  :  Project website

SIFT Flow: Dense Correspondence across Different Scenes

C. Liu, J. Yuen, A. Torralba, J. Sivic, W. T. Freeman
European Conference on Computer Vision, ECCV 2008
Paper (pdf)

Understanding camera trade-offs through a Bayesian analysis of light field projections

A. Levin, W. T. Freeman, and F. Durand
European Conference on Computer Vision, ECCV 2008
Paper (pdf)  :  Longer technical report

80 million tiny images: a large dataset for non-parametric object and scene recognition

A. Torralba, R. Fergus, and W. T. Freeman
IEEE Transactions on Pattern Analysis and Machine Intelligence., Volume 30 , Issue 11 (November 2008), Pages: 1958-1970
Paper (pdf)  :  Project website

Creating and exploring a large photorealistic virtual space

J. Sivic, B. Kaneva, A. Torralba, S. Avidan and W. T. Freeman
First IEEE Workshop on Internet Vision, associated with CVPR 2008
Paper (pdf)

Human-assisted motion annotation

C. Liu, W. T. Freeman, E. H. Adelson and Y. Weiss
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008
Paper (pdf)  :  Project website

The patch transform and its applications to image editing

Taeg Sang Cho, Moshe Butman, Shai Avidan, William T. Freeman
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008

Best Poster Award, CVPR 2008

Paper (pdf)  :  Project website

Unsupervised Discovery of Visual Object Class Hierarchies

J. Sivic, B. C. Russell, A. Zisserman, W. T. Freeman, and A. A. Efros
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008
Paper (pdf)

Describing visual scenes using transformed objects and parts

E. Sudderth, A. Torralba, W. T. Freeman, and A. Willsky
International Journal of Computer Vision, 77, May 2008
Paper (pdf)

Signal and Image Processing with Belief Propagation

E. Sudderth and W. T. Freeman
DSP Application Column, IEEE Signal Processing Magazine, Mar. 2008
Paper (pdf)

Automatic estimation and removal of noise from a single image

C. Liu, R. Szeliski, S. B. Kang, C. L. Zitnick, and W. T. Freeman
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol 30, No. 2, pp. 299-314, Feb., 2008
Paper (pdf)

A reliable skin mole localization scheme

Taeg Sang Cho, William T. Freeman, Hensin Tsao
2007 IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA), in conjunction with 2007 ICCV
Paper (pdf)

Image and depth from a conventional camera with a coded aperture

A. Levin, R. Fergus, F. Durand, and W. T. Freeman
ACM Trans. On Graphics (Proc. SIGGRAPH) 2007
Paper (pdf)  :  Project website

Learning Compressed Sensing

Yair Weiss, Hyun Sung Chang and William T. Freeman
45th Allerton Conference on Communication, Control, and Computing, 2007
Paper (pdf)

Object Recognition by Scene Alignment

B. C. Russell, A. Torralba, C. Liu, R. Fergus, W. T. Freeman
Advances in Neural Information Processing Systems (NIPS), 2007
Paper (pdf)

Face Hallucination: theory and practice

C. Liu, H. Y. Shum and W. T. Freeman
International Journal of Computer Vision, Vol. 75, no. 1, pp. 115-134, October, 2007
Paper (pdf)  :  Project website

Learning Gaussian Conditional Random Fields for Low-Level Vision

M. F. Tappen, C. Liu, W. T. Freeman, and E. H. Adelson
IEEE Computer Vision and Pattern Recognition (CVPR) 2007
Paper (pdf)

What makes a good model of natural images?

Y. Weiss and W. T. Freeman
IEEE Computer Vision and Pattern Recognition (CVPR) 2007
Paper (pdf)

Sharing visual features for multiclass and multiview object detection

A. Torralba, K. P. Murphy, and W. T. Freeman
IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 29, no. 5, pp. 854-869, May, 2007
Paper (pdf)

Exploring defocus matting: non-parametric acceleration, super-resolution, and off-center matting

N. Joshi, W. Matusik, S. Avidan, H. Pfister, and W. T. Freeman
IEEE Computer Graphics and Applications, special issue on Computational Photography, March, 2007
Paper (pdf)  :  Project website

Removing camera shake from a single image

R. Fergus, B. Singh, A. Hertzmann, S. Roweis, and W. T. Freeman
SIGGRAPH 2006
Paper (pdf)  :  Project website

Analysis of contour motions

C. Liu, W. T. Freeman and E. H. Adelson
Advances in Neural Information Processing Systems (NIPS 2006)

Received Outstanding Student Paper Award

Paper (pdf)

Bayesian model of human color constancy

D. H. Brainard, P. Longere, P. B. Delahunt, W. T. Freeman, J. M. Kraft, and B. Xiao
Journal of Vision, 6, 1267-1281, doi:10.1167/6.11.10. 2006
Paper (pdf)

Depth from familiar objects: a hierarchical model for 3d scenes

E. Sudderth, A. Torralba, W. T. Freeman, and A. Willsky
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) New York, NY, June, 2006
Paper (pdf)

Estimating Intrinsic Component Images using Non-Linear Regression

M. Tappen, E. Adelson, and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) New York, NY, June, 2006
Paper (pdf)

Noise estimation from a single image

C. Liu, W. T. Freeman, R. Szeliski, and S. B. Kang
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) New York, NY, June, 2006
Paper (pdf)

Using multiple segmentations to discover objects and their extent in image collections

B. C. Russell, , A. Efros, J. Sivic, W. T. Freeman, and A. Zisserman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) New York, NY, June, 2006

Motion Magnification

Ce Liu, Antonio Torralba, William Freeman, Fredo Durand, and Edward Adelson
SIGGRAPH 2005
Paper (pdf)  :  Project website

Object detection and localization using local and global features

K. Murphy, A. Torralba, D. Eaton, W. T. Freeman
Lecture Notes in Computer Science (unrefeered). Sicily workshop on object recognition, 2005
Paper (pdf)

Shared features for multiclass object detection

A. Torralba, K. Murphy, W. T. Freeman
Towards Category-Level Object Recognition. Springer Lecture Notes in Computer Science (invited submission). 2005
Paper (pdf)

Describing Visual Scenes using Transformed Dirichlet

E. Sudderth, A. Torralba, W. Freeman, and A. Willsky
Neural Information Processing Systems (NIPS), Vancouver, B.C., Dec. 2005

An Ensemble Prior of Image Structure for Cross-modal Inference

S. Ravela, A. Torralba, W. T. Freeman
International Conference on Computer Vision (ICCV), Beijing, China, vol. 1, pp. 871-876, Oct. 2005
Paper (pdf)

Discovering Objects and their Location in Images

J. Sivic, B. Russell, A. A. Efros, A. Zisserman, W. T. Freeman
International Conference on Computer Vision (ICCV), Beijing, China, Oct. 2005

Received 2017 Helmholtz prize, test-of-time award.

Paper (pdf)

Learning Hierarchical Models of Scenes, Objects, and Parts

E. Sudderth, A. Torralba, W. Freeman, and A. Willsky
International Conference on Computer Vision (ICCV), Beijing, China, Oct. 2005
Paper (pdf)

LabelMe: a database and web-based tool for image annotation

B. Russell, A. Torralba, K. Murphy, W. T. Freeman
MIT AI Lab Memo AIM-2005-025, September, 2005
Paper (pdf)

Recovering Intrinsic Images from a Single Image

M. F. Tappen, W. T. Freeman, and E. H. Adelson
IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 27, Issue 9, September 2005, Pages 1459 – 1472
Paper (pdf)

Distributed Occlusion Reasoning for Tracking with Nonparametric Belief Propagation

Propagation E. Sudderth, M. Mandel, W. Freeman, and A. Willsky
Neural Information Processing Systems (NIPS) 2004
Paper (pdf)

Using the forest to see the trees: a graphical model relating features, objects, and scenes

K. Murphy, A. Torralba, and W. T. Freeman
Advances in Neural Information Processing Systems 16 (NIPS), Vancouver, BC, MIT Press, 2004
Paper (pdf)

Contextual Models for Object Detection Using Boosted Random Fields

Antonio Torralba, Kevin P. Murphy, William T. Freeman
Neural Information Processing Systems (NIPS), Vancouver, B.C., Dec. 2004
Paper (pdf)

Single-frame Text Super-resolution: A Bayesian Approach

G. Dalley, W. T. Freeman, and J. Marks
International Conference on Image Processing (ICIP), Oct. 2004
Paper (pdf)

Efficient graphical models for processing images

M. F. Tappen, B. C. Russell, and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) Washington, DC, 2004
Paper (pdf)

Sharing visual features for multiclass and multiview object detection

A. Torralba, K. P. Murphy, and W. T. Freeman
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) Washington, DC, 2004; MIT CSAIL technical report
Paper (pdf)

Visual Hand Tracking Using Nonparametric Belief Propagation

E. Sudderth, M. Mandel, W. Freeman, and A. Willsky
Workshop on Generative Model Based Vision, CVPR, June 2004
Project website

Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters

M. F. Tappen and W. T. Freeman
IEEE Intl. Conference on Computer Vision (ICCV), Nice, France, October, 2003
Paper (pdf)

Context-based vision system for place and object recognition

A. Torralba, K. P. Murphy, W. T. Freeman, and M. A. Rubin
IEEE Intl. Conference on Computer Vision (ICCV), Nice, France, October, 2003
Paper (pdf)

Exploiting spatial and spectral image regularities for color constancy

B. Singh, W. T. Freeman, and D. H. Brainard
3rd Intl. Workshop on Statistical and Computational Theories of Vision (associated with Intl. Conf. on Computer Vision), Nice, France, October, 2003
Paper (pdf)

Exploiting the sparse derivative prior for super-resolution and image demosaicing

M. F. Tappen, B. C. Russell, and W. T. Freeman
3rd Intl. Workshop on Statistical and Computational Theories of Vision (associated with Intl. Conf. on Computer Vision), Nice, France, October, 2003
Paper (pdf)

Nonparametric Belief Propagation and Facial Appearance Estimation

E. B. Sudderth, A. T. Ihler, W. T. Freeman and A. S. Willsky
IEEE Computer Vision and Pattern Recognition (CVPR), Madison, WI, June, 2003
Project website

Properties and Applications of Shape Recipes

A. Torralba and W. T. Freeman
IEEE Computer Vision and Pattern Recognition (CVPR), Madison, WI, June, 2003
Paper (pdf)

Shape-Time Photography

W. T Freeman and H. Zhang
IEEE Computer Vision and Pattern Recognition (CVPR), Madison, WI, June, 2003
Paper (pdf)

Learning style translation for the lines of a drawing

W. T. Freeman, J. B. Tenenbaum, E. Pasztor
ACM Transactions on Graphics, January, 2003
Paper (pdf)

Shape-Time Photography

W. T. Freeman and H. Zhang
MIT Artificial Intelligence Lab Memo 2002-002
Paper (pdf)

Shape Recipes: Scene Representations that Refer to the Image

William T. Freeman, Antonio Torralba
Neural Information Processing Systems (NIPS) 2002
Paper (pdf)

Example-based super-resolution

William T. Freeman, Thouis R. Jones, and Egon C. Pasztor
IEEE Computer Graphics and Applications, March/April, 2002.

 Test-of-time award given in 2023 from IEEE CG&A.

Paper (pdf)  :  Project website

Learning Joint Statistical Models for Audio-Visual Fusion and Segregation

J. W. Fisher, T. Darrell, W. T. Freeman and P. Viola
Advances in Neural Information Processing Systems 13, edited by T. K. Leen, T. G. dietterich, and V. Tresp, pp. 772-778, 2001

Learning local evidence for shading and reflectance

M. Bell and W. T. Freeman
International Conference on Computer Vision, Vancouver, BC, Canada, 2001
Paper (pdf)

Learning Motion Analysis

W. T. Freeman, J. A. Haddon, and E. C. Pasztor
Statistical Theories of the Brain, edited by R. Rao, B. Olshausen, and M. Lewicki, MIT Press, 2001
Paper (pdf)

Bayesian Reconstruction of 3D Human Motion from Single-Camera Video

Nicholas R. Howe, Michael E. Leventon, William T. Freeman
Advances in Neural Information Processing Systems 12, edited by S. A. Solla, T. K. Leen, and K-R Muller, 2000
Paper (pdf)

Learning Low-Level Vision

W. T. Freeman, E. C. Pasztor, O. T. Carmichael
International Journal of Computer Vision, 40(1), pp. 25-47, 2000
Paper (pdf)

Separating style and content with bilinear models

Joshua B. Tenenbaum, William T. Freeman
Neural Computation 12(6), pp. 1247-1283, 2000
Paper (pdf)

Markov networks for super-resolution

W. T. Freeman and E. C. Pasztor
Proceedings of 34th Annual Conference on Information Sciences and Systems (CISS 2000), Dept. Electrical Engineering, Princeton University, Princeton, NJ 08544-5263, March, 2000
Paper (pdf)

Learning low-level vision

William T. Freeman, Egon C. Pasztor
Appeared in IEEE International Conference on Computer Vision, Corfu, Greece, 1999
Paper (pdf)

Artificial retina chips as on-chip image processors and gesture-oriented interfaces

H. Kage, W. T. Freeman, Y. Miyake, E. Funatsu, K. Tanaka, K. Kyuma
Optical Engineering, Vol. 38, No. 12, December, 1999
Paper (pdf)

Computer vision for computer interaction

W. T. Freeman, P. Beardsley, H. Kage, K. Tanaka, K. Kyuma, C. Weissman
SIGGRAPH Computer Graphics magazine, November, 1999
Paper (pdf)

An Inexpensive, All Solid-state Video and Data Recorder for Accident Reconstruction

W. S. Yerazunis, D. L. Leigh, W. T. Freeman, R. S. Bardsley
Presented at the 1999 SAE International Congress and Exposition in Detroit, Michigan on March 3, 1999; published as SAE Technical Paper number 1999-10-1299
Paper (pdf)

Markov networks for low-level vision

William T. Freeman, Egon C. Pasztor
Presented at Workshop on Statistical and Computational Theories of Vision
Paper (pdf)

Learning to estimate scenes from images

William T. Freeman, Egon C. Pasztor
Neural Information Processing Systems, volume 11, 1999
Paper (pdf)

A factorization approach to grouping

P. Perona and W. T. Freeman
Proceedings, European Conference on Computer Vision, 1998
Paper (pdf)

Bayesian model of surface perception

W. T. Freeman and P. A. Viola
Neural Information Processing Systems, volume 10, pp. 787-793, 1998
Paper (pdf)

Bayesian Estimation of 3-D Human Motion

Michael E. Leventon, William T. Freeman
Tech. Rep. TR98-06, Mitsubishi Electric Research Laboratories, Cambridge, MA, July 1998
Paper (pdf)

Computer vision for interactive computer graphics

W. T. Freeman, D. Anderson, P. Beardsley, C. Dodge, H. Kage, K. Kyuma, Y. Miyake, M. Roth, K. Tanaka, C. Weissman, W. Yerazunis
IEEE Computer Graphics and Applications, volume 18, number 3, May-June, pp. 42-53, 1998
Paper (pdf)

Separating Style and Content

J. B. Tenenbaum and W. T. Freeman
Neural Information Processing Systems 9, M. C. Mozer, M. I. Jordan and T. Petsche, Eds., Morgan Kaufmann, San Mateo, CA., 1997
Paper (pdf)

Bayesian Color Constancy

D. H. Brainard and W. T. Freeman
Journal of the Optical Society of America, A, 14(7), pp. 1393-1411, July, 1997
Paper (pdf)

Learning bilinear models for two-factor problems in vision

W. T. Freeman and J. B. Tenenbaum
IEEE Conference on Computer Vision and Pattern Recognition (CVPR '97), Puerto Rico, U. S. A., June, 1997

Received Outstanding Paper prize, CVPR '97

Paper (pdf)

Exploiting the generic viewpoint assumption

W. T. Freeman
International Journal Computer Vision, 20 (3), 243-261, 1996
Paper (pdf)

The generic viewpoint assumption in a Bayesian framework

W. T. Freeman
Perception as Bayesian Inference, D. Knill and W. Richards, eds., Cambridge University Press, 365 - 390, 1996
Paper (pdf)

Computer vision for computer games

W. T. Freeman, K. Tanaka, J. Ohta, and K. Kyuma
, 2nd International Conference on Automatic Face and Gesture Recognition, Killington, VT, USA, pp. 100-105
Paper (pdf)

Example-based head tracking

S. Niyogi and W. T. Freeman
2nd International Conference on Automatic Face and Gesture Recognition, Killington, VT, USA.
Paper (pdf)

A gesture controlled human interface using an artificial retina chip

Y. Miyake, W. T. Freeman, J. Ohta, K. Tanaka, and K. Kyuma
IEEE Lasers and Electro-Optics (LEOS '96), July, 1996

Artificial retina chips as image input interfaces for multimedia systems

T. Toyoda, Y. Nitta, E. Funatsu, Y. Miyake, W. Freeman, J. Ohta, and K. Kyuma
Optoelectronics and Communications Conference, OECC'96, Chiba, Japan, July, 1996

The steerable pyramid: a flexible architecture for multi-scale derivative computation

E. P. Simoncelli and W. T. Freeman
2nd Annual IEEE International Conference on Image Processing, Washington, DC. October, 1995
Paper (pdf)

Bayesian decision theory, the maximum local mass estimate, and color constancy

W. T. Freeman and D. H. Brainard
Fifth International Conference on Computer Vision, IEEE Computer Society, Cambridge, MA, U.S.A, June, 1995, pp. 210 - 217
Paper (pdf)

Orientation histograms for hand gesture recognition

W. T. Freeman and M. Roth
International Workshop on Automatic Face- and Gesture- Recognition, IEEE Computer Society, Zurich, Switzerland, June, 1995, pp. 296-301

Winner, 2013 Test-of-time award from Face and Gesture Recognition conference. Here is a video prepared to accept the test-of-time award, describing the work in its context, in .mov format, or in .mpeg format.

Paper (pdf)

Television control by hand gestures

W. T. Freeman and C. Weissman
International Workshop on Automatic Face- and Gesture- Recognition, IEEE Computer Society, Zurich, Switzerland, June, 1995, pp. 179-183
Paper (pdf)

Bayesian method for recovering surface and illuminant properties from photosensor responses

D. H. Brainard and W. T. Freeman
Human Vision, Visual Processing and Digital Display V, SPIE Proceedings Series, vol. 2179, 1994

Computer vision for computer graphics

I. Carlbom (course organizer) and W. Freeman, G. Klinker, W. Lorensen, R. Szeliski, D. Terzopoulos, and K. Waters
SIGGRAPH '94 and '95 course notes

Demonstration of an interactive environment for collaboration and learning

C. Rich, R. C. Waters, C. Strohecker, Y. Schabes, W. T. Freeman, M. C. Torrance, A. R. Golding, and M. Roth
IEEE Computer, Vol. 27, No. 12, Dec. 1994

The generic viewpoint assumption in a framework for visual perception

W. T. Freeman
Nature, vol. 368, p. 542 - 545, April 7, 1994
Paper (pdf)

Exploiting the generic view assumption to estimate scene parameters

W. T. Freeman
IEEE International Conference on Computer Vision, Berlin, Germany, 1993

Building and using catalogs of grey-level junctions

E. H. Adelson, P. Sinha, and W. T. Freeman
Proc. 15th European Conference on Visual Perception, Edinburgh, Scotland. August, 1993

Steerable Filters and Local Analysis of Image Structure

W. T. Freeman
Ph.D. Thesis, Massachusetts Institute of Technology, 1992
Paper (pdf)

Shiftable Multi-Scale Transforms

E. P. Simoncelli, W. T. Freeman, E. H. Adelson and D. J. Heeger
IEEE Trans. Information Theory, Special Issue on Wavelets. Vol. 38, No. 2, pp. 587-607, March 1992
Paper (pdf)

The design and use of steerable filters

W. T. Freeman and E. H. Adelson
IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 891 - 906, September, 1991
Paper (pdf)

Motion without movement

W. T. Freeman, E. H. Adelson, and D. J. Heeger
ACM Computer Graphics, vol. 25, no. 4, (SIGGRAPH '91), pp. 27 - 30, July, 1991

A neural network for image noise removal

J. G. Chen, Q. Tian, and W. T. Freeman
1st National Conference on Neural Networks and their Applications, Beijing, 1990

(in Chinese)

Pyramids and multiscale representations

E. H. Adelson, E. P. Simoncelli, and W. T. Freeman
Proc. 13th European Conference on Visual Perception, Paris, 1990
Paper (pdf)

Steerable filters for early vision, image analysis, and wavelet decomposition

W. T. Freeman and E. H. Adelson
IEEE International Conference on Computer Vision, Osaka, Japan, 1990

Helmholtz Prize--test-of-time award winner.

Applications of neural networks in image processing

W. T. Freeman, J. G. Chen, and Q. Tian
Automation Soc. of China Symp. on Neural Networks, pp. 46 - 55, Beijing, 1989

(in Chinese)

Steerable filters

W. T. Freeman and E. H. Adelson
OSA Topical Meeting on Image Understanding and Machine Vision, Technical Digest Series Volume 14, June, 1989

Image processing to remove grain from photographs

W. T. Freeman
Society of Photographic Scientists and Engineers 42nd Annual Conference, pp. 457 - 460, May, 1989

Computer Image Processing of STEM Images of Tobacco Mosaic Virus

E. J. Kirkland, W. T. Freeman, M. Ohtsuki, M. S. Isaacson, and B. S. Siegal
Ultramicroscopy 6, 367-76 (1981)