Normal AI - Image models overview

There are many different tasks you can pursue with images! The most interesting concept you’ll find is “stuff” vs “things,” which you can explore when reading about semantic segmentation and instance segmentation.

Tasks and models for image analysis

Image classification

Image classification allows you to put images into category. Typically these are yes/no questions.

Object Detection: Finding things in photos

There are a handful of different ways that computers can look at images, and one of the options is “stuff” versus “things.” Instance segmentation can be used to find “things:” each individual person, car, tree, etc in an image.

Semantic Segmentation: Finding stuff in photos

There are a handful of different ways that computers can look at images, and one of the options is “stuff” versus “things.” Semantic segmentation can be used to find “stuff,” the number of pixels dedicated to people, cars, vegetation, etc in an image.

VQA: Asking questions about pictures

Visual Question Answering (VQA) is a way to ask questions about pictures! If we want to get technical, it isn’t actually an image model: it’s a multimodal model that understands both images and text! The text part comes in when understanding what your question means.

Image description

There are a handful of different ways that computers can look at images, and one of the options is “stuff” versus “things.” Instance segmentation can be used to find “things:” each individual person, car, tree, etc in an image.