# Architecture

## Data pipeline

1. Input: target web URL (the edited video)
2. Processing:
   1. Request metadata from an external source (e.g. Internet Archive)
   2. Data parsing
      * source locations (e.g. URLs)
      * time (start and end of source, start and end of target URL)
      * other extra information (filmed by, title etc.)
      * captions metadata
   3. Generate a manifest file - Have an chimera HLS/Dash manifest file (.m3u8 or .mpd) from the data, such that your playlist contains the metadata for segments and the rendering is prioritised. JWPlayer supports embedding manifest files <https://support.jwplayer.com/customer/en/portal/articles/1430240-adaptive-streaming> ![](https://developer.apple.com/library/content/referencelibrary/GettingStarted/AboutHTTPLiveStreaming/Art/stream_playlists_2x.png) Example: <https://bitdash-a.akamaihd.net/content/sintel/hls/playlist.m3u8> Note: It was pointed out the exact segment difficult to extract out exactly, but this is just a nice-to-have feature so the segments can be matched up with best effort.
3. Output:
   * Captions
     * Make the captions go the right way... (Top to bottom)
   * Video
     * Render a poorer quality video for the source file as well. Just because the video is a lot smaller.
     * Pop up video frame that would be easier to close / be able to toggle between the top and bottom video.
     * What happens when.. fade? Overlapping video? Silent?

## Data model

Data model will change based on the API endpoint of the database we get our information from. For now we have a mock manifest placed in the repository.

```
    "id": "http://example.org/sample_video.json",
    "type": "Manifest",
    "label": "ABC NY Local News Segment on Trump Exclusive Interview",
    "description": "This is a description of the ABC Local news segment.",
    "sequences": {
        "type": "Sequence",
        "canvases": [
            {
                "id": "http://example.org/sample_video/canvas/1",
                "duration": 132,
                "content": [
                    {
                        "id": "http://example.org/sample_video/content/page/1",
                        "type": "AnnotationPage",
                        "items": [
                            {
                                "id": "http://example.org/sample_video/content/anno/1",
                                "type": "Annotation",
                                "motivation": "painting",
                                "body": {
                                    "id": "http://example.org/media/abc_local_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=0,35"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/2",
                                "type": "Annotation",
                                "motivation": "annotation",
                                "body": {
                                    "id": "http://example.org/media/trump_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=36,62"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/3",
                                "type": "Annotation",
                                "motivation": "painting",
                                "body": {
                                    "id": "http://example.org/media/abc_local_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=63,77"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/4",
                                "type": "Annotation",
                                "motivation": "annotation",
                                "body": {
                                    "id": "http://example.org/media/trump_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=78,122"
                            },
                            {
                                "id": "http://example.org/sample_video/content/anno/5",
                                "type": "Annotation",
                                "motivation": "painting",
                                "body": {
                                    "id": "http://example.org/media/abc_local_interview.mp4",
                                    "type": "Video",
                                    "format": "video/mp4"
                                },
                                "target": "http://example.org/sample_video/canvas/1#t=123,132"
                            },
                        ]
                    }
                ]
            }
        ]
    }
}
```

See .m3u8 / mpd

## Users needs

Not considered as this is the mock of a mock of a mock.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://textav.gitbook.io/textav-event/unconference-projects/transprovenance/architecture.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.