Selecting the most informative frames with Lightly
In this section, we will use an active ML tool called Lightly. Lightly is a data curation tool that’s equipped with a web platform that enables users to choose the optimal subset of samples for maximizing model accuracy. Lightly’s algorithms can process substantial volumes of data, such as 10 million images or 10 thousand videos, in less than 24 hours.
The web app allows users to explore their datasets using filters such as sharpness, luminance, contrast, file size, and more. They can then use these filters to explore correlations between these characteristics.
Users can also search for similar images or objects within the app and look into the embeddings (principal component analysis (PCA), T-distributed stochastic neighbor embedding (TSNE), and uniform manifold approximation and projection (UMAP)). Embeddings refers to vector representations of images that are learned by deep neural networks. They capture visual...
