MULTIDATA is an online platform for the study of multimodal communication. We offer an AI-based pipeline to analyze speech and gesture data from videos, as well as other resources for developing audiovisual collections and exploiting them for education, research, and professional applications.
The MULTIDATA team is constantly integrating the most relevant open-source tools, or developing tools of our own.
How to join us? Click Log in (upper right corner) to create your account.
Interested in the MULTIDATA project? Want to learn how to use our multimodal pipeline?
Join us for the MULTIDATA Summer Workshop on Tuesday, July 8, 2025, at the Max Planck Institute (Nijmegen), just before the ISGS conference.
This hands-on workshop will introduce participants to the MULTIDATA pipeline, covering transcription, speech analysis and OpenPose, followed by interactive sessions on applications in education and research. MULTIDATA is an ERASMUS PLUS KA220 HED project, involving the universities of Murcia, Radboud Nijmegen, and FAU Erlangen-Nürnberg as partners, and the MPI Psycholinguistics and the Red Hen Lab as associated partners. We offer an online platform for the study of multimodal communication (https://www.multi-data.eu/), including an AI-based pipeline to analyze speech and gesture data from videos, as well as other resources for developing audiovisual collections, as well as didactic materials and suggestions for exploiting video data inside and outside the classroom. This workshop will help you make the most of our open-source tools for analyzing gesture along with its co-occurring language and prosody.
MULTIDATA, the cutting-edge data analytics platform, has officially entered its test phase, marking a significant milestone in its development.
This phase involves rigorous testing to ensure the platform's robustness, accuracy, and scalability under real-world conditions. The primary goal is to identify and rectify any potential issues, ensuring the system can handle large volumes of data and deliver reliable insights.
During this phase, selected users will have the opportunity to explore its features and provide valuable feedback, helping to refine the platform further.