Doctoral & Postdoctoral Seminar

Date & Location

  • February 3, 2023
  • Nice, Valrose (Laboratoire J.A Dieudonné)

Program

10:30 - 11:00
Valerya Strizhkova (Chair of F. Bremond) 
Inria STARS team

Multi-View Video Masked Autoencoder for Emotion Recognition

Masking and reconstruction strategy is an efficient solution to self-supervised video pre-training. Video masked autoencoder (VideoMAE) has shown state-of-the-art results in action recognition both on big and small datasets. Here we expand VideoMAE, proposing a more challenging pre-task that reconstructs different views of a masked input, the Multi-View Video Masked (MVVM) strategy. As downstream task we select emotion recognition and we use MEAD as the enabling dataset, where subjects are recorded from different angulation (e.g. front, top, down, lateral etc.). The reconstruction of different views allows the model to learn more powerful representations for each frame. Even small facial expressions, visible only from some views, are encoded in the latent space. With this approach we show for the first time the end-to-end video emotion classification with the big ViT-B network. We increase the recognition of low intensity/subtle emotions of around 8%, when compared with state-of-the-art methods. Moreover, the MEAD dataset contains high and low intensity emotions which, thanks to the multi-view approach, enables fine-grained classification. The capability of classifying sub-categories is tested on a very small (200 videos) in-the-wild dataset where multiple shades of anger are represented (MFA dataset). The MVVM autoencoder is able to transfer knowledge and reach state-of-the-art emotion recognition accuracy.

11:00 - 11:30 
Lucie Cadorel (invited outside 3iA)
I3S / Inria Wimmics team

Geospatial Knowledge in Real Estate Listings : Extracting and Localizing Uncertain Spatial Information from Text

Spatial information is found in numerous unstructured (textual) documents such as travel blogs, social media in emergencies or Real Estate advertisements, and could be very difficult to extract and localize. Usually, digital gazetteers are used to match geospatial objects to their boundaries but they might be incomplete. Indeed, humans often use spatial expressions with toponyms (e.g., "West of Nice, France", "Nearby the Promeande des Anglais"), place types instead of toponyms (e.g., "Next to the beach") or local and unofficial place names (e.g., "La Banane in Cannes") that are not found in official gazetteers. For example, Real Estate professionals often exaggerate boundaries of a place that is popular and well-reputed since the location is one of the most valuable factors of purchasing. Thus, a number of studies have proposed to enrich gazetteers by estimating and representing the vernacular places. However, only a few approaches have taken into account vague spatial expressions such as "nearby" and places without toponyms (e.g, "the university"). In our work, we propose an automatic workflow to extract spatial information from Real Estate advertisements and retrieve a location approximation of the uncertain places in order to enrich geographic gazetteers.

11:30 - 12:00

Open discussion on the two contributions



 
Save the Date!
Next Seminars:
  • March 3, 2023 at Inria
  • April 7, 2023 at Inria
  • May 5, 2023 at Nice, Campus Valrose
  • June 2, 2023 at Inria
  • July 7, 2023 at Inria
Past Seminars

Doctoral & Postdoctoral Seminar #21

Speakers:

  • David Loiseaux (Inria)Towards multiparameter persistent homology descriptors for machine learning
  • Alessandro Betti (Inria)Deep Learning to See
See details

Doctoral & Postdoctoral Seminar #20

Speakers:

  • Yacine Khacef (Université Côte d'Azur)High-Resolution Traffic Monitoring with Distributed Acoustic Sensing and AI
  • Daniel Inzunza (Inria)A PINN approach for traffic state estimation and model calibration based on loop detector flow data
See details

Doctoral & Postdoctoral Seminar #19

Speakers:

  • Lucia Innocenti (Inria) Analysis of Multi-centric AI-based frame-works in prostate segmentation
  • Riccardo Taiello (Inria) Privacy Preserving Image Registration

See details

Doctoral & Postdoctoral Seminar #18

Speakers:

  • Rémi Felin (UCA, I3S) | Optimizing the Computation of a Possibilistic Heuristic to Test OWL 2 SubClassOf Axioms Against RDF Data
  • Huiyu Li (Inria, Epione) | Data Stealing Attack on Medical Images: Is it Safe to Export Networks from Data Lakes?
See details

Doctoral & Postdoctoral Seminar #17

Speakers:

  • Benjamin Ocampo (UCA, I3S) | "We Need Two Poke Flutes to Wake You Up'' an In-depth Analysis of Implicit and Subtle Hate Speech Messages
  • Tong Zhao (Inria) | Progressive Discrete Domains for Implicit Surface Reconstruction

See details

Doctoral & Postdoctoral Seminar #16

Speakers:

  • Prof. Ludovic Dibiaggio | Introduction to the OTESIA institute
  • Daniel Inzunza (Inria) | PINNs approach for traffic model calibration
  • Angelo Rodio (Inria) | Resource-aware Federated Learning

See details

Doctoral & Postdoctoral Seminar #15

Speakers:

  • Andrea Castagnetti (UCA, LEAT) | Neural information coding for efficient spike-based image denoising
  • Christos Bountzouklis (UCA, LJAD) | Environmental factors affecting wildfire-burned areas in southeastern France

See details

Doctoral & Postdoctoral Seminar #14

Speakers:

  • Antonia Ettorre (UCA, I3S) | A systematic approach to identify the information captured by Knowledge Graph Embeddings
  • Victoriya Kashtanova (Inria) | Deep Learning Approach for Cardiac Electrophysiology Modeling

See details

Doctoral & Postdoctoral Seminar #13

Speakers:

  • Aude Sportisse (Inria) | Informative labels in Semi-Supervised Learning
  • Alexandra Würth (Inria) | Data driven traffic management by Macroscopic models

See details

Doctoral & Postdoctoral Seminar #12

Speakers:

  • Hind Dadoun (Inria) | AI-based Real Time Diagnosis of Abdominal Ultrasound Images
  • Victor Jung (UCA) | Checking Constraint Satisfaction

See details

Doctoral & Postdoctoral Seminar #11

Speakers:

  • Bogdan Kozyrskiy (EURECOM) | Binarization for Optical Processing Units via REINFORCE
  • Paul Tourniaire (Inria) | Attention-based Multiple Instance Learning for Histopathology

See details

Doctoral & Postdoctoral Seminar #10

Speakers:

  • Etrit Haxholli (Inria) | On the Estimation of Shape Parameters of Tails of Marginal Distributions
  • Cedric Vincent-Cuaz (UCA) | Semi-relaxed Gromov-Wasserstein divergence with applications on graphs

See details

Doctoral & Postdoctoral Seminar #9

Speakers:

  • Santiago Marro (CNRS) | Natural Language Argumentation Quality Assessment maps
  • Artem Muliukov (UCA) | Cortex-inspired multimodal AI approach based on self-organizing 

See details

Doctoral & Postdoctoral Seminar #8

Speakers:

  • Kristof Huszar (Inria) | Towards Efficient Algorithms in Computational Topology
  • Mauro Zucchelli (Inria) | Diffusion MRI based Brain Tissue Microstructure Characterization Using Autoencoder Neural-Networks

See details

Doctoral & Postdoctoral Seminar #7

Speakers:

  • Vasiliki Stergiopoulou (CNRS) | COL0RME: Super-Resolution Microscopy Based on the Localization of Sparse Blinking Fluorophores
  • Ali Ballout (UCA) | Predicting the Possibilistic Score of Atomic Candidate OWL Axioms

See details

Doctoral & Postdoctoral Seminar #6

Speakers:

  • Hugo Schmutz (Inria) | Towards safe deep semi-supervised learning
  • Amirhossein Tavakoli (MINES ParisTech) | Hybrid combinatorial optimization and machine learning algorithms for energy-efficient water network

See details

Doctoral & Postdoctoral Seminar #5

Speakers:

  • Ayse Unsal (Eurecom) | A Statistical Threshold for Adversarial Classification in Laplace Mechanisms
  • Ashwin James (CNRS) | Inference of choice granularity via learning model selection in a cognitive task 

See details

Doctoral & Postdoctoral Seminar #4

Speakers:

  • Mohsen Tabejamaat (Inria) | Conditional image generation using structural priors
  • William Hammersley (UCA) | Randomizing gradient descents on the space of probability measures
  • Athanasios Vasileiadis (UCA) | Exploration noise for Mean Field Games

See details

Doctoral & Postdoctoral Seminar #3

Speakers:

  • Amar Bouali (3IA Côte d'Azur) | Introduction to the Partnership and Innovation initiatives of 3IA Côte d'Azur
  • Antoine Collin (CNRS) | Automatic cell type annotation for cell atlas construction
  • Ziming Liu (Inria) | High-resolution Detection Network for Small Objects

See details

Doctoral & Postdoctoral Seminar #2

Speakers:

  • Aurélie Delort (3IA Côte d'Azur) | Presentation of the Education & Training program
  • Boris Shminke (CNRS) | Using Denoising Autoencoder for Cayley table completion task
  • Dingge Liang (Inria) | A Deep Latent Recommender System based on User Ratings and Reviews
  • Martijn Van Den Ende (UCA) | Fibre-optics, earthquakes, and a zebra: intelligent signal denoising with Deep Learning

See details

Doctoral & Postdoctoral Seminar #1