FrameTrail (https://frametrail.org) is an open source software that let's you experience, manage and edit interactive video directly in your web browser.
In the last months we have worked with the German Parliament to make session protocols searchable, provide time-based transcripts. analyze the video archive and provide various sets of time-based annotations (using FrameTrail as a player component).
Abgeordnetenwatch.de — parliament watch
Automated linking with additional information
“Citizen heckling / interjection button” lets people ask questions in real-time while watching the speech and those get forwarded
Used Aeneas for forced alignment: https://github.com/readbeyond/aeneas
Next steps — integrating into existing parliamentwatch platform, index transcripts with solr/elasticsearch, optimise workflow to autoindex new speeches as they become available