Architecture

Data pipeline

1. Input: target web URL (the edited video)

2. Processing:

   1. Request metadata from an external source (e.g. Internet Archive)

   2. Data parsing

      • source locations (e.g. URLs)

      • time (start and end of source, start and end of target URL)

      • other extra information (filmed by, title etc.)

      • captions metadata

   3. Generate a manifest file - Have an chimera HLS/Dash manifest file (.m3u8 or .mpd) from the data, such that your playlist contains the metadata for segments and the rendering is prioritised. JWPlayer supports embedding manifest files https://support.jwplayer.com/customer/en/portal/articles/1430240-adaptive-streaming Example: https://bitdash-a.akamaihd.net/content/sintel/hls/playlist.m3u8 Note: It was pointed out the exact segment difficult to extract out exactly, but this is just a nice-to-have feature so the segments can be matched up with best effort.

3. Output:

   • Captions

     • Make the captions go the right way... (Top to bottom)

   • Video

     • Render a poorer quality video for the source file as well. Just because the video is a lot smaller.

     • Pop up video frame that would be easier to close / be able to toggle between the top and bottom video.

     • What happens when.. fade? Overlapping video? Silent?

Data model

Data model will change based on the API endpoint of the database we get our information from. For now we have a mock manifest placed in the repository.

    "id": "http://example.org/sample_video.json",
    "type": "Manifest",
    "label": "ABC NY Local News Segment on Trump Exclusive Interview",
    "description": "This is a description of the ABC Local news segment.",
    "sequences": {
        "type": "Sequence",
        "canvases": [
            {
                "id": "http://example.org/sample_video/canvas/1",
                "duration": 132,
                "content": [
                    {
                        "id": "http://example.org/sample_video/content/page/1",
                        "type": "AnnotationPage",
                        "items": [
                            {
                                "id": "http://example.org/sample_video/content/anno/1",
                                "type": "Annotation",
                                "motivation": "painting",
                                "body": {
                                    "id": "http://example.org/media/abc_local_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=0,35"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/2",
                                "type": "Annotation",
                                "motivation": "annotation",
                                "body": {
                                    "id": "http://example.org/media/trump_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=36,62"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/3",
                                "type": "Annotation",
                                "motivation": "painting",
                                "body": {
                                    "id": "http://example.org/media/abc_local_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=63,77"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/4",
                                "type": "Annotation",
                                "motivation": "annotation",
                                "body": {
                                    "id": "http://example.org/media/trump_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=78,122"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/5",
                                "type": "Annotation",
                                "motivation": "painting",
                                "body": {
                                    "id": "http://example.org/media/abc_local_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=123,132"
                            },
                        ]
                    }
                ]
            }
        ]
    }
}

See .m3u8 / mpd

Users needs

Not considered as this is the mock of a mock of a mock.