Objectives
In caption generator systems, the identification of the figures depicted in an image depends on a matrix of weights for each of the classes with which the system has been trained. Current caption generators are trained with images that reflect present time lifestyles. Therefore the matrix is in fact a TimeMatrix of the present. The course will show how the identification of classes varies as the matrix of weights depends on data relative to past centuries. This produces a time machine effect where the bike of a person in the TimeMatrix of the present becomes a horse of Saint George in the TimeMatrix of the 15th century.
This webinar will demonstrate the Saint George on a Bike project results and potential to adapt automatically produced descriptions of paintings to the time period when they were created. The course will pose and discuss challenges for researchers. At the end of the course, a demo will be conducted to show correction of anachronisms and class refinement examples.
Requirements
Basic knowledge of Natural Language Processing a plus.
Using Neural Networks a plus.
Learning Outcomes
Academic Staff
Joaquim More Lopez (CASE Department, Barcelona Supercomputing Center)
Artem Reshetnikov (CASE Department, Barcelona Supercomputing Center)
Albin Larsson (Europeana)
Further information
Learn more about the Saint George on a Bike project: https://saintgeorgeonabike.eu/