Artists use color, intensity, and texture to draw attention to specific areas of an image. Texture use is particularly interesting because it is common for texture to be elided (or simplified) depending upon the viewpoint, projected size, and the importance of the object.
I have developed two systems for allowing the user to paint view-dependent texture directly on the model. Both of these systems allow the user to pick particular viewpoints and projection image-sizes, then paint onto the model. When the object is rendered, the system blends between the appropriate texture maps. Sort of Mip-mapping on steroids.
The primary difference between the two systems is how the texture maps are created. In the first, the object is already parameterized. In the second, the projected object itself serves as a texture map parameterization. This involves some cleverness with the depth map in areas of occlusion.
We have also automated this process, to some extent, by letting the user choose both a texture and color for lighting the object. This is a generalization of the Gooch warm-cool rendering, extended to textures. The challenge here is how to smoothly change between textures, both from shadowed to lit areas and as the object moves. This paper presents both object-based (a-la the previous papers) and image-based approaches.
Artists often combine abstraction with realism when rendering objects with a lot of detail, such as trees. They outline the basic shape of the tree with a shaded blob, then introduce detail where needed to create the illusion of detail everywhere. This paper is a semi-automated approach of this flavor - the user still has a great deal of control over the degree of abstraction versus realism, and other rendering attributes.
Photographers spend a great deal of time and effort creating good lighting, especially for objects that have concavities and various material types. In this paper, we capture the object under many different lights, then employ a painting approach to re-light the object the way we want. Joint work with Jack Tumblin and Bobby Bodenheimer.
We are continuing to look into the questions of image-editing based on the human visual system.