Jitendra Malik Jitendra Malik

725 Soda Hall
(510) 642-8736
Lab Page
AFFILIATIONS Professor Emeritus of Vision Science and Optometry,
Dean Emeritus Optometry, 1992-2001

Computer vision and computational modeling of human vision

I am interested in constructing computational models of early visual processes such as texture perception, stereopsis and motion processing. This modeling is to be done in the context of available psychophysical and physiological data – it is unlikely that models designed purely on a priori considerations will either be correct or be taken seriously by experimentalists. Computational models force us to make explicit various assumptions; they provide important tests of internal consistency and can also be simulated for robustness.

Our recent work has been on the problems of texture discrimination and stereopsis. We have been able to construct a simple, physiologically plausible model of texture discrimination, which has been able to quantitatively explain psychophysical data on the degree of discriminability of different texture pairs. In stereopsis, we have developed a novel computational model which enables the treatment of position, orientation, and spatial frequency disparity in a single framework.

Selected Publications

Learning to Detect Natural Image Boundaries Using Local Brightness, Color and Texture Cues. David Martin, Charless Fowlkes and Jitendra Malik. IEEE Trans. on Pattern Analysis and Machine Intelligence, 26(5), 530-549, May 2004. paper

Twist Based Acquisition and Tracking of Animal and Human Kinematics. Christoph Bregler, Jitendra Malik and Katherine Pullen International Journal of Computer Vision, 56(3), 179-194, Feb-March 2004. paper

Spectral Grouping Using the Nystrom Method. Charless Fowlkes, Serge Belongie, Fan Chung and Jitendra Malik IEEE Trans. on Pattern Analysis and Machine Intelligence, 26(2), 214-225, February 2004. paper

Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying. Chad Carson, Serge Belongie, Hayit Greenspan and Jitendra Malik IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(8), 1026-1038, August 2002. paper

Shape Matching and Object Recognition Using Shape Contexts. Serge Belongie, Jitendra Malik and Jan Puzicha IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(4), 509-522, April 2002. paper

Extracting Objects from Range and Radiance Images. Yizhou Yu, Andras Ferencz and Jitendra Malik IEEE Trans. on Visualization and computer Graphics, 7(4), 351-364, Oct-Dec. 2001. paper

Contour and Texture Analysis for Image Segmentation. Jitendra Malik, Serge Belongie, Thomas Leung and Jianbo Shi International Journal of Computer Vision, 43(1), 7-27, June 2001. paper

Representing and Recognizing the Visual Appearance of Materials using Three-Dimensional Textons. Thomas Leung and Jitendra Malik International Journal of Computer Vision,43(1), 29-44, June 2001. paper

Normalized Cuts and Image Segmentation. Jianbo Shi and Jitendra Malik IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 888-905, August 2000. Paper

Image Recognition: Visual Grouping, Recognition and Learning. Joachim M. Buhmann, Jitendra Malik and Pietro Perona. Proc. of National Academy of Sciences, 96(25), 14203-14204, Dec 1999. Paper

Stereoscopic Occlusion junctions. Jitendra Malik, Barton L. Anderson and Chad Charowhas. Nature Neuroscience, 2(9), Sept 1999, pp.840-843.

Inverse Global Illumination: Recovering Reflectance, Models of Real Scenes from Photographs. Yizhou Yu, Paul Debevec, Jitendra Malik and Tim Hawkins, Proc. of ACM SIGGRAPH 1999, 215-224. paper

A comparative study of vision-based lateral control strategies for autonomous highway driving. Camillo J. Taylor, Jana Kosecka, Robert Blasi and Jitendra Malik, Int. Journal of Robotics Research, 18(5), May 1999, pp. 442-453. paper

Tracking people with twists and exponential maps. Christoph Bregler and Jitendra Malik. IEEE Conf. Computer Vision and Pattern Recognition, 1998, pp. 8-15. paper

A Realtime Computer Vision System for vehicle tracking and traffic surveillance. B. Coifman, D. Beymer, P. Mclauchlan and J. Malik Transportation Research C 6C (4), Aug. 1998, 271-288.

(More papers can be found at Malik Publications.)