Michael J. Black

Michael J. Black is an American-born computer scientist working in Tübingen, Germany.

He is a founding director at the Max Planck Institute for Intelligent Systems where he leads the Perceiving Systems Department in research focused on computer vision, machine learning, and computer graphics.

He is also an Honorary Professor at the University of Tübingen.

A version of this work received the IEEE Outstanding Paper Award at CVPR 1991 and the Helmholtz Prize at ICCV 2013 for work that has "stood the test of time".

His early focus on statistical modeling of motion, particularly at motion discontinuities, led to two other prize papers.

His work with David Fleet on the "Probabilistic Detection and Tracking of Motion Boundaries" won honorable mention for the Marr Prize at ICCV'99.

In 1993, Black and Jepson used mixture models to represent optical flow fields with multiple motions (also called "layered" optical flow).

This introduced the use of Expectation Maximization (EM) to the field of computer vision.

In the 2000s, Black worked with John Donoghue and others at Brown University to create the technology behind the BrainGate neural prosthetics technology.

Black and colleagues developed Bayesian methods to decode neural signals from motor cortex.

The team was the first to use Kalman filtering and particle filtering to decode motor cortical ensemble activity.

With these Bayesian decoding methods, the team demonstrated the successful point-and-click control of a computer cursor by a human with paralysis and the decoding of full arm and hand movement in non-human primates.

Black is best known for his work on human motion and shape estimation.

With Hedvig Sidenbladh and David Fleet, he introduced the use of particle filtering for tracking 3D articulated human motion.

This work was awarded the Koenderink Koenderink Prize for Fundamental Contributions in Computer Vision at ECCV 2000.

His current work focuses on modeling and estimating human shape and pose from images and video.

Black's work with Stefan Roth "On the spatial statistics of optical flow" received honorable mention for the Marr Prize at ICCV 2005.

His team was the first to fit a learned 3D human body model to multi-camera image data at CVPR 2007, under clothing at ECCV 2008, from a single image at ICCV 2009, and from RGB-D data at ICCV 2011.

His group produced the popular SMPL 3D body model (and various extensions like FLAME for 3D human faces, MANO for 3D hands, and SMPL-X, an expressive 3D body model with hands and faces) and popularized methods for estimating 3D body shape from images.

SMPL is widely used in both academia and industry and was one of the core technologies licensed by Body Labs Inc.

Loper and Black popularized "differentiable rendering", which has become an important component of self-supervised training of neural networks for problems like facial analysis.

Classical methods for analysis by synthesis formulate an objective function and then differentiate it.

Black has won all three major test-of-time prizes in computer vision: the Koenderink Prize at the European Conference on Computer Vision (ECCV) in 2010 and 2022, the Helmholtz Prize at the International Conference on Computer Vision (ICCV) in 2013, and the Longuet-Higgins Prize at the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) in 2022.

In 2023 he received the PAMI Distinguished Researcher Award.

Black's thesis reformulated optical flow estimation as a robust M-estimation problem.

The main observation was that spatial discontinuities in image motion and violations of the standard brightness constancy assumption could be treated as outliers.

Reformulating the classical optimization problem as a robust estimation problem produced more accurate results.

This "Black and Anandan" optical flow algorithm has been widely used, for example, in special effects.

The method was used to compute optical flow for the painterly effects in What Dreams May Come and for registering 3D face scans in The Matrix Reloaded.

His work with Deqing Sun and Stefan Roth on the "Secrets of Optical Flow" was awarded the 2020 Longuet- Higgins Prize.

The prize is given annually by the IEEE Pattern Analysis and Machine Intelligence (PAMI) Technical Committee for "Contributions in Computer Vision that Have Withstood the Test of Time."

The "secrets" paper helped establish the state of the art in the field and led to the widely used Classic+NL flow algorithm.

The "Black and Anandan" method helped popularize robust statistics in computer vision.

This was facilitated by several papers that connected robust penalty functions to classical "line processes" used in Markov Random Fields (MRFs) at the time.

Black and Rangarajan characterized the formal properties of robust functions that have an equivalent line-process form and provided a process to convert between these formulations (known now as "Black-Rangarajan Duality" ).

Black and colleagues applied these ideas to image denoising, anisotropic diffusion, and principal-component analysis (PCA).

The robust formulation was hand crafted and used small spatial neighborhoods.

The work on Fields of Experts with Stefan Roth removed these restrictions.

They learned the potential functions of an MRF with large spatial cliques by modeling the field potentials as a product of experts.

Their formulation can be viewed as a shallow convolutional neural network.