Tiltomo is an experimental search engine that works in just this fashion, allowing you to find similar images in two ways. You can search for images that have similar color and texture characteristics, or you can look for images with similar "themes," which adds an analysis of subject matter to the color/texture mix.