|AFFILIATIONS||Professor Emeritus of Vision Science and Optometry,
Dean Emeritus Optometry, 1992-2001
Computer vision and computational modeling of human vision
I am interested in constructing computational models of early visual processes such as texture perception, stereopsis and motion processing. This modeling is to be done in the context of available psychophysical and physiological data – it is unlikely that models designed purely on a priori considerations will either be correct or be taken seriously by experimentalists. Computational models force us to make explicit various assumptions; they provide important tests of internal consistency and can also be simulated for robustness.
Our recent work has been on the problems of texture discrimination and stereopsis. We have been able to construct a simple, physiologically plausible model of texture discrimination, which has been able to quantitatively explain psychophysical data on the degree of discriminability of different texture pairs. In stereopsis, we have developed a novel computational model which enables the treatment of position, orientation, and spatial frequency disparity in a single framework.
Learning to Detect Natural Image Boundaries Using Local Brightness, Color and Texture Cues. David Martin, Charless Fowlkes and Jitendra Malik. IEEE Trans. on Pattern Analysis and Machine Intelligence, 26(5), 530-549, May 2004. paper
Twist Based Acquisition and Tracking of Animal and Human Kinematics. Christoph Bregler, Jitendra Malik and Katherine Pullen International Journal of Computer Vision, 56(3), 179-194, Feb-March 2004. paper
Spectral Grouping Using the Nystrom Method. Charless Fowlkes, Serge Belongie, Fan Chung and Jitendra Malik IEEE Trans. on Pattern Analysis and Machine Intelligence, 26(2), 214-225, February 2004. paper
Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying. Chad Carson, Serge Belongie, Hayit Greenspan and Jitendra Malik IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(8), 1026-1038, August 2002. paper
Shape Matching and Object Recognition Using Shape Contexts. Serge Belongie, Jitendra Malik and Jan Puzicha IEEE Trans. on Pattern Analysis and Machine Intelligence, 24(4), 509-522, April 2002. paper
Extracting Objects from Range and Radiance Images. Yizhou Yu, Andras Ferencz and Jitendra Malik IEEE Trans. on Visualization and computer Graphics, 7(4), 351-364, Oct-Dec. 2001. paper
Contour and Texture Analysis for Image Segmentation. Jitendra Malik, Serge Belongie, Thomas Leung and Jianbo Shi International Journal of Computer Vision, 43(1), 7-27, June 2001. paper
Representing and Recognizing the Visual Appearance of Materials using Three-Dimensional Textons. Thomas Leung and Jitendra Malik International Journal of Computer Vision,43(1), 29-44, June 2001. paper
Normalized Cuts and Image Segmentation. Jianbo Shi and Jitendra Malik IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8), 888-905, August 2000. Paper
Image Recognition: Visual Grouping, Recognition and Learning. Joachim M. Buhmann, Jitendra Malik and Pietro Perona. Proc. of National Academy of Sciences, 96(25), 14203-14204, Dec 1999. Paper
Stereoscopic Occlusion junctions. Jitendra Malik, Barton L. Anderson and Chad Charowhas. Nature Neuroscience, 2(9), Sept 1999, pp.840-843.
Inverse Global Illumination: Recovering Reflectance, Models of Real Scenes from Photographs. Yizhou Yu, Paul Debevec, Jitendra Malik and Tim Hawkins, Proc. of ACM SIGGRAPH 1999, 215-224. paper
A comparative study of vision-based lateral control strategies for autonomous highway driving. Camillo J. Taylor, Jana Kosecka, Robert Blasi and Jitendra Malik, Int. Journal of Robotics Research, 18(5), May 1999, pp. 442-453. paper
Tracking people with twists and exponential maps. Christoph Bregler and Jitendra Malik. IEEE Conf. Computer Vision and Pattern Recognition, 1998, pp. 8-15. paper
A Realtime Computer Vision System for vehicle tracking and traffic surveillance. B. Coifman, D. Beymer, P. Mclauchlan and J. Malik Transportation Research C 6C (4), Aug. 1998, 271-288.
(More papers can be found at Malik Publications.)