All Publications


  • Seeing Tree Structure from Vibration
    Tianfan Xue, Jiajun Wu, Zhoutong Zhang, Chengkai Zhang, Joshua B. Tenenbaum, and William T. Freeman
    European Conference on Computer Vision (ECCV), 2018

  • Learning-based Video Motion Magnification
    Tae-Hyun Oh, Ronnachai Jaroensri, Changil Kim, Mohamed Elgharib, Frédo Durand, William T. Freeman, Wojciech Matusik
    European Conference on Computer Vision (ECCV), 2018. Oral presentation.

  • Medical Image Imputation from Image Collections
    Adrian V Dalca, Katherine L Bouman, William T Freeman, Natalia S Rost, Mert R Sabuncu, Polina Golland
    IEEE Transactions on Medical Imaging

  • Best-buddies similarity—robust template matching using mutual nearest neighbors
    Shaul Oron, Tali Dekel, Tianfan Xue, William T Freeman, Shai Avidan
    IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 2018

  • Unsupervised Training for 3D Morphable Model Regression
    Kyle Genova, Forrester Cole, Aaron Maschinot, Aaron Sarna, Daniel Vlasic, William T Freeman
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

  • Smart, Sparse Contours to Represent and Edit Images
    T Dekel, C Gan, D Krishnan, C Liu, WT Freeman
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

  • Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling
    Xingyuan Sun, Jiajun Wu, Xiuming Zhang, Zhoutong Zhang, Chengkai Zhang, Tianfan Xue, Joshua B. Tenenbaum, and William T. Freeman
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

  • Learning and Using the Arrow of Time
    Donglai Wei, Joseph Lim, Andrew Zisserman, William T Freeman
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018

  • Inferring Light Fields from Shadows
    Manel Baradad, Vickie Ye, Adam B Yedidia, Frédo Durand, William T Freeman, Gregory W Wornell, Antonio Torralba
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018. Spotlight presentation.

  • Exploiting Occlusion in Non-Line-of-Sight Active Imaging
    Christos Thrampoulidis, Gal Shulkind, Feihu Xu, William T Freeman, Jeffrey Shapiro, Antonio Torralba, Franco Wong, Gregory Wornell
    IEEE Transactions on Computational Imaging, 2018

  • Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separation
    Ariel Ephrat, Inbar Mosseri, Oran Lang, Tali Dekel, Kevin Wilson, Avinatan Hassidim, William T Freeman, Michael Rubinstein
    SIGGRAPH, 2018

  • Cognitive Load Estimation in the Wild
    Lex Fridman, Bryan Reimer, Bruce Mehler, William T Freeman
    CHI Conference on Human Factors in Computing Systems, 2018

  • 3D Interpreter Networks for Viewer-Centered Wireframe Modeling
    Jiajun Wu, Tianfan Xue, Joseph J Lim, Yuandong Tian, Joshua B Tenenbaum, Antonio Torralba, William T Freeman
    International Journal of Computer Vision (IJCV), 2018

  • Learning Sight from Sound: Ambient Sound Provides Supervision for Visual Learning
    Andrew Owens, Jiajun Wu, Josh H McDermott, William T Freeman, Antonio Torralba
    Interactional Journal of Computer Vision (IJCV), 2018

  • Reconstructing Video of Time-Varying Sources from Radio Interferometric Measurements
    Katherine L Bouman, Michael D Johnson, Adrian V Dalca, Andrew A Chael, Freek Roelofs, Sheperd S Doeleman, William T Freeman
    IEEE Transactions on Computational Imaging, 2018

  • Shape and Material from Sound
    Zhoutong Zhang, Qiujia Li, Zhengjia Huang, Jiajun Wu, Joshua B. Tenenbaum, and William T. Freeman
    Neural Information Processing Systems (NIPS), 2017. Spotlight presentation.

  • Learning to See Physics via Visual De-animation
    Jiajun Wu, Erika Lu, Pushmeet Kohli, William T. Freeman, and Joshua B. Tenenbaum
    Neural Information Processing Systems (NIPS), 2017. Spotlight presentation.

  • Marrnet: 3D shape reconstruction via 2.5D sketches
    Jiajun Wu, Yifan Wang, Tianfan Xue, Xingyuan Sun, William T Freeman, Joshua B Tenenbaum
    Neural Information Processing Systems (NIPS), 2017

  • Turning Corners into Cameras: Principles and Methods
    Katherine L Bouman, Vickie Ye, Adam B Yedidia, Frédo Durand, Gregory W Wornell, Antonio Torralba, William T Freeman
    International Conference on Computer Vision (ICCV), 2017

  • Motion microscopy for visualizing and quantifying small motions
    Neal Wadhwa, Justin G Chen, Jonathan B Sellon, Donglai Wei, Michael Rubinstein, Roozbeh Ghaffari, Dennis M Freeman, Oral Büyüköztürk, Pai Wang, Sijie Sun, Sung Hoon Kang, Katia Bertoldi, Frédo Durand, William T Freeman
    Proceedings of the National Academy of Sciences (PNAS), 2017

  • Generative modeling of audible shapes for object perception
    Zhoutong Zhang, Jiajun Wu, Qiujia Li, Zhengjia Huang, James Traer, Josh H McDermott, Joshua B Tenenbaum, William T Freeman
    International Conference on Computer Vision (ICCV), 2017

  • Guest Editorial Special Issue on Extreme Imaging
    WT Freeman, A Savakis, Y Schechner, N Snavely, W Heidrich
    IEEE Transactions on Computational Imaging 3 (3), 382-383

  • 3DTV at home: eulerian-lagrangian stereo-to-multiview conversion
    Petr Kellnhofer, Piotr Didyk, Szu-Po Wang, Pitchaya Sitthi-Amorn, William Freeman, Fredo Durand, Wojciech Matusik
    ACM Transactions on Graphics (TOG) 36 (4), 146 (SIGGRAPH) July, 2017

  • Synthesizing normalized faces from facial identity features
    Forrester Cole, David Belanger, Dilip Krishnan, Aaron Sarna, Inbar Mosseri, William T Freeman
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017

  • On the Effectiveness of Visible Watermarks
    T Dekel, M Rubinstein, C Liu, WT Freeman
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017

  • Population based image imputation
    Adrian V Dalca, Katherine L Bouman, William T Freeman, Natalia S Rost, Mert R Sabuncu, Polina Golland
    International Conference on Information Processing in Medical Imaging (IPMI), 2017. Best Poster Award.

  • Eulerian Video Magnification and Analysis
    Neal Wadhwa, Hao-Yu Wu, Abe Davis, Michael Rubinstein, Eugene Shih, Gautham J. Mysore, Justin G. Chen, Oral Buyukozturk, John V. Guttag, William T. Freeman, Frédo Durand
    Communications of the ACM, Vol. 60 No. 1, Pages 87-95, January 2017

  • Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks
    Tianfan Xue, Jiajun Wu, Katherine L. Bouman, William T. Freeman
    Neural Information Processing Systems (NIPS), 2016. Oral presentation.

  • Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling
    Jiajun Wu, Chengkai Zhang, Tianfan Xue, William T. Freeman, Joshua B. Tenenbaum
    Neural Information Processing Systems (NIPS), 2016

  • Video Camera–Based Vibration Measurement for Civil Infrastructure Applications
    Justin G Chen, Abe Davis, Neal Wadhwa, Frédo Durand, William T Freeman, Oral Büyüköztürk
    Journal of Infrastructure Systems, Vol 3 (2)

  • Interactive Visualization of Spatially Amplified GNSS Time‐Series Position Fields
    Brendan J Meade, William T Freeman, James Wilson, Fernanda Viegas, Martin Wattenberg
    Seismological Research Letters, Vol 88(1), pp 126-130, 2016

  • Observing—and imaging—active galactic nuclei with the Event Horizon Telescope
    Vincent L Fish, Kazunori Akiyama, Katherine L Bouman, Andrew A Chael, Michael D Johnson, Sheperd S Doeleman, Lindy Blackburn, John FC Wardle, William T Freeman, Event Horizon Telescope Collaboration
    Galaxies 4(4) p. 54, 2016

  • Ambient Sound Provides Supervision for Visual Learning
    Andrew Owens, Jiajun Wu, Josh McDermott, William Freeman, Antonio Torralba.
    European Conference on Computer Vision (ECCV), 2016. Oral presentation.

  • Single Image 3D Interpreter Network
    Jiajun Wu, Tianfan Xue, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman
    European Conference on Computer Vision (ECCV), 2016. Oral presentation.

  • Physics 101: Learning Physical Object Properties from Unlabeled Videos
    Jiajun Wu, Joseph J. Lim, Hongyi Zhang, Joshua B. Tenenbaum, and William T. Freeman
    British Machine Vision Conference (BMVC), 2016.

  • A Comparative Evaluation of Approximate Probabilistic Simulation and Deep Neural Networks as Accounts of Human Physical Scene Understanding
    Renqiao Zhang, Jiajun Wu, Chengkai Zhang, William T Freeman, Joshua B Tenenbaum
    Annual Meeting of the Cognitive Science Society (CogSci), 2016. Oral presentation.

  • Visually Indicated Sounds
    A Owens, P Isola, J McDermott, A Torralba, EH Adelson, WT Freeman
    Computer Vision and Pattern Recognition (CVPR) 2016

  • Computational Imaging for VLBI Image Reconstruction
    Katherine L. Bouman, MD Johnson, Daniel Zoran, Vincent L. Fish, Sheperd S. Doeleman, William T. Freeman
    Computer Vision and Pattern Recognition (CVPR) 2016

  • Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning
    Jiajun Wu, Ilker Yildirim, Joseph J. Lim, William T. Freeman, Joshua B. Tenenbaum
    Neural Information Processing Systems, 127-135 (NIPS), 2015

  • Deviation magnification: revealing departures from ideal geometries
    Neal Wadhwa, Tali Dekel, Donglai Wei, Fredo Durand, William T. Freeman
    ACM Transactions on Graphics (TOG) 34 (6), 226 (SIGGRAPH Asia), 2015

  • Revealing and modifying non-local variations in a single image
    Tali Dekel, Tomer Michaeli, Michal Irani, William T. Freeman
    ACM Transactions on Graphics (TOG) 34 (6), 227 (SIGGRAPH Asia), 2015

  • A computational approach for obstruction-free photography
    Tianfan Xue, Michael Rubinstein, Ce Liu, William T. Freeman
    ACM Transactions on Graphics (TOG) 34 (4), (SIGGRAPH), 2015

  • Modal identification of simple structures with high-speed video using motion magnification
    Justin G Chen, Neal Wadhwa, YJ Cha, Fredo Durand, William T Freeman, Oral Buyukozturk
    Journal of Sound and Vibration vol 345, pages 58-71, 2015

  • Reflection Removal using Ghosting Cues
    YiChang Shih, Dilip Krishnan, Fredo Durand, William T. Freeman
    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015

  • Best-Buddies Similarity for Robust Template Matching
    Tali Dekel, Shaul Oron, Michael Rubinstein, Shai Avidan, William T. Freeman
    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015

  • Video Magnification in Presence of Large Motions
    Mohamed Elgharib, Mohamed Hefeeda, Fredo Durand, William T. Freeman
    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015

  • Visual Vibrometry: Estimating Material Properties from Small Motions in Video
    Abe Davis, Katherine L. Bouman, Justin G. Chen, Michael Rubinstein, Fredo Durand, William T. Freeman
    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015

  • The Aperture Problem for Refractive Motion
    Tianfan Xue, Hossein Mobahi, Fredo Durand, William T. Freeman
    Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015

  • Developments with Motion Magnification for Structural Modal Identification Through Camera Video
    Justin G Chen, Neal Wadhwa, Fredo Durand, William T Freeman, Oral Buyukozturk
    Dynamics of Civil Structures, Volume 2, pages 49-57, 2015

  • A World of Movement
    Fredo Durand, William T. Freeman, Michael Rubinstein
    Scientific American, Volume 312, Number 1, January 2015

  • Refraction Wiggles for Measuring Fluid Depth and Velocity from Video
    Tianfan Xue, Michael Rubinstein , Neal Wadhwa , Anat Levin, Frédo Durand, William T. Freeman
    European Conference on Computer Vision (ECCV), 2014

  • The Visual Microphone: Passive Recovery of Sound from Video
    Abe Davis, Michael Rubinstein, Neal Wadhwa, Gautham Mysore, Fredo Durand, William T. Freeman
    ACM Transactions on Graphics, Volume 33, Number 4 (Proc. SIGGRAPH), 2014.

  • Style Transfer for Headshot Portraits
    YiChang Shih, Sylvain Paris, Connelly Barnes, William T. Freeman, Frédo Durand
    ACM Transactions on Graphics (SIGGRAPH), 2014

  • Camouflaging an Object from Many Viewpoints
    Andrew Owens, Connelly Barnes, Alex Flint, Hanumant Singh, William T. Freeman
    IEEE Computer Vision and Pattern Recognition (CVPR), 2014

  • Seeing the Arrow of Time
    Lyndsey Pickup, Zheng Pan, Donglai Wei, Yichang Shih, Andrew Zisserman, William T. Freeman, Bernhard Schoelkopf
    IEEE Computer Vision and Pattern Recognition (CVPR), 2014

  • A Compositional Model for Low-Dimensional Image Set Representation
    Hossein Mobahi, Ce Liu, and William T. Freeman
    IEEE Computer Vision and Pattern Recognition (CVPR), 2014

  • Rethinking color cameras
    Ayan Chakrabarti, William T. Freeman, Todd Zickler
    IEEE International Conference on Computational Photography (ICCP), 2014.

  • Accidental Pinhole and Pinspeck Cameras
    Antonio Torralba and William T. Freeman
    International Journal of Computer Vision

     110 (2), 92-112


  • Riesz Pyramids for Fast Phase-Based Video Magnification
    Neal Wadhwa, Michael Rubinstein, Frédo Durand, William T. Freeman
    International Conference on Computational Photography (ICCP), 2014.

  • Structural modal identification through high speed camera video
    Justin G Chen, Neal Wadhwa, Young-Jin Cha, Frédo Durand, William T. Freeman, Oral Buyukozturk
    Topics in Modal Analysis I, Volume 7, pages 191-197, Springer International Publishing, 2014.

  • Fabricating BRDFs at High Spatial Resolution Using Wave Optics
    A. Levin, D. Glasner, Y. Xiong, F. Durand, W. Freeman, W. Matusik, T. Zickler
    ACM Transactions on Graphics, Volume 32, Number 4 (Proc. SIGGRAPH) 2013

  • Phase-based Video Motion Processing
    Neal Wadhwa, Michael Rubinstein, Fredo Durand, William T. Freeman
    ACM Transactions on Graphics, Volume 32, Number 4 (Proc. SIGGRAPH) 2013

  • Shape Anchors for Data-Driven Multi-view Reconstruction
    Andrew Owens, Jianxiong Xiao, Antonio Torralba, William Freeman
    International Conference on Computer Vision (ICCV), 2013

  • Group Norm for Learning Structured SVMs with Unstructured Latent Variables
    Daowen Chen, Dhruv Batra, William T. Freeman
    2013 IEEE International Conference on Computer Vision (ICCV)

  • Estimating the Material Properties of Fabric from Video
    Katherine L. Bouman, Bei Xiao, Peter Battaglia, William T. Freeman
    2013 IEEE International Conference on Computer Vision (ICCV)

  • Data-driven Hallucination of Different Times of Day from a Single Outdoor Photo
    YiChang Shih, Sylvain Paris, Frédo Durand, William T. Freeman
    ACM Transactions on Graphics (SIGGRAPH Asia) 2013

  • How To Do Research
    William T. Freeman
    (Informal note written for new graduate students), March 6, 2013

  • Eulerian Video Magnification for Revealing Subtle Changes in the World
    Hao-Yu Wu, Michael Rubinstein, Eugene Shih, John Guttag, Fredo Durand, William T. Freeman
    ACM Transactions on Graphics, Volume 31, Number 4 (Proc. SIGGRAPH) 2012

  • Towards Longer Long-Range Motion Trajectories
    Michael Rubinstein, Ce Liu, William T. Freeman
    British Machine Vision Conference (BMVC) 2012

  • Shapecollage: Occlusion-Aware, Example-Based Shape Interpretation
    Forrester Cole, Phillip Isola, William T. Freeman, Fredo Durand, Edward Adelson
    European Conference on Computer Vision (ECCV), October 2012

  • Patch Complexity, Finite Pixel Correlations and Optimal Denoising
    Anat Levin, Boaz Nadler, Fredo Durand, William T. Freeman
    European Conference on Computer Vision (ECCV), October 2012

  • Annotation Propagation in Large Image Databases via Dense Image Correspondence
    Michael Rubinstein, Ce Liu, William T. Freeman
    European Conference on Computer Vision (ECCV), October 2012

  • Exploiting compositionality to explore a large space of model structures
    Roger B. Grosse, Ruslan Salakhutdinov, William T. Freeman, and Joshua B. Tenenbaum
    Conf. on Uncertainty in Artificial Intelligence (UAI), August 2012

    Best Student Paper Prize


  • Accidental pinhole and pinspeck cameras: revealing the scene outside the picture
    Antonio Torralba and William T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2012

  • Laser Speckle Photography for Surface Tampering Detection
    YiChang Shih, Abe Davis, Sam Hasinoff, Fredo Durand, William T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2012

  • Diffuse Reflectance Imaging with Astronomical Applications
    Sam Hasinoff, Anat Levin, Philip Goode and William T. Freeman
    IEEE Intl. Conf. on Computer Vision (ICCV), 2011

  • Evaluation of Image Features Using a Photorealistic Virtual World
    Biliana Kaneva, Antonio Torralba, William Freeman
    IEEE Intl. Conf. on Computer Vision (ICCV), 2011

  • CG2Real: Improving the Realism of Computer Generated Images using a Large Collection of Photographs
    Micah K. Johnson, Kevin Dale, Shai Avidan, Hanspeter Pfister, William T. Freeman, Wojciech Matusik
    IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG) 2011

  • A Perfect Match (technical perspective)
    William T. Freeman
    Communications of the ACM, November, 2011, vol. 54, no. 11

  • Efficient Marginal Likelihood Optimization in Blind Deconvolution
    A. Levin, Y. Weiss, F. Durand, and W. T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition, June 2011

  • Blur Kernel Estimation Using the Radon Transform
    Taeg Sang Cho, Sylvain Paris, William Freeman, Berthold Horn
    Proc. 23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011

  • Motion Denoising with Application to Time-lapse Photography
    Michael Rubinstein, Ce Liu, Peter Sand, Fredo Durand, William Freeman
    Proc. 23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011

  • Where computer vision needs help from computer science
    W. T. Freeman
    ACM-SIAM Symposium on Discrete Algorithms, January, 2011

  • Search-and-Replace Editing for Personal Photo Collections
    Samuel W. Hasinoff, Martyna Jozwiak, Fredo Durand, and William T. Freeman
    IEEE Intl. Conf. on Computational Photography (ICCP), 2010

  • Infinite Images: Creating and Exploring a Large Photorealistic Virtual Space
    Biliana Kaneva, Josef Sivic, Antonio Torralba, Shai Avidan and William T. Freeman
    Proceedings of the IEEE, volume 98, issue 8, pages 1391 – 1407, 2010

  • Motion blur removal with orthogonal parabolic exposures
    Taeg Sang Cho, Anat Levin, Fredo Durand, and William T. Freeman
    IEEE Intl. Conf. on Computational Photography (ICCP), 2010

  • Matching and Predicting Street Level Images
    Biliana Kaneva, Josef Sivic, Antonio Torralba, Shai Avidan and William T. Freeman
    Workshop for Vision on Cognitive Tasks, European Conf. on Computer Vision (ECCV) 2010

  • Nonparametric Belief Propagation
    Erik B. Sudderth, Alexander T. Ihler, Michael Isard, William T. Freeman, and Alan S. Willsky
    Communications of the ACM, October, 2010

  • The Patch Transform
    T. S. Cho, S. Avidan, and W. T. Freeman
    IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 32, issue 8, pages 1489 – 1501, August, 2010

  • Noise-Optimal Capture for High Dynamic Range Photography
    Samuel W. Hasinoff, Fredo Durand, and William T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010

  • Analyzing Spatially-varying Blur
    A. Chakrabarti, Todd Zickler and William T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010

  • Latent Hierarchical Structural Learning for Object Detection
    L. Zhu, Y. Chen, A. Torralba, A. Yuille and W. T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010

  • Part and Appearance Sharing: Recursive Compositional Models for Multi-View Multi-Object Detection
    L. Zhu, Y. Chen, A. Torralba, W. T. Freeman, and A. Yuille
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010

  • A Probabilistic Image Jigsaw Puzzle Solver
    T. S. Cho, S. Avidan and W. T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010

  • A Content-Aware Image Prior
    T. S. Cho, N. Joshi, C. L. Zitnick, S. B. Kang, R. Szeliski and W. T. Freeman
    IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2010

  • Using the Forest to See the Trees: Exploiting Context for Visual Object Detection and Localization
    Antonio Torralba, Kevin Murphy and William T. Freeman
    Communications of the ACM, March 2010, Vol. 53, No. 3

  • Segmenting Scenes by Matching Image Composites
    B. C. Russell, A. A. Efros, J. Sivic, W. T. Freeman, and A. Zisserman
    Neural Information Processing Systems (NIPS) 2009

  • Nonparametric Bayesian Texture Learning and Synthesis
    Long Zhu, Yuanhao Chen, William Freeman, Antonio Torralba
    Neural Information Processing Systems (NIPS) 2009

  • Ground-truth dataset and baseline evaluations for intrinsic image algorithms
    R. Grosse, M.K. Johnson, E.H. Adelson, and W.T. Freeman
    International Conference on Computer Vision, 2009

  • Time-constrained Photography
    S. W. Hasinoff, K. N. Kutulakos, F. Durand and W. T. Freeman
    Proc. 12th IEEE International Conference on Computer Vision (ICCV 2009, oral presentation)