7

Is that possible, that a video (.mp4 or etc) had two video streams and we could to do work with each stream individually ? (like we do with 2 audio streams and we can remove any of them)..

if so:

1) do you know which video editors can handle such videos? Adobe Premiere , Sony Vegas, DaVinci or ... ?

2) At this moment, my typical MP4 files are converted by youtube (after upload) to i.e. mpeg-4 10 AVC. And will those 2-stream videos will be converted to 1-stream video anyway? (maybe I have to ask that to YT forum, right?)

3
  • 1
    Certainly can. MP4 files can contain any number of video, audio, subtitle and other data tracks.
    – stib
    Commented Mar 15, 2017 at 12:15
  • 1
    In practice, yes. Although I'm sure the field storing the number of streams has a max limit of 2^16 or 32.
    – Gyan
    Commented Mar 15, 2017 at 13:00
  • @T.Todua, out of curiosity, what is your use case? Commented Mar 15, 2017 at 23:43

2 Answers 2

10

Yes. MPEG-4 Part 14 (the MP4 container format) supports any number of objects (e.g. video, audio and subtitle streams) and isn't limited to only one stream per content type.

In practice however, you seldom see a video file that has multiple video streams, because the range of applications for this is very limited. I would also advise you not to put multiple video streams into one file, as (a) users don't expect it, many won't know how to switch the video track or not notice there is a second video track at all and (b) many players (soft- and hardware) aren't equipped to play files with multiple video streams and either won't have any option to switch between streams or fail to play the file completely.

It is also more common to use Matroska (.mkv) containers for video files with multiple audio/subtitle streams, but even with those, you rarely see files with more than one video stream.

7
  • 2
    1) do you know which video editors can handle such videos? Adobe Premiere , Sony Vegas or?... 2) will youtube convert such video file into 1-streamed file (at this moment, my typcal m4 files are converted by youtube to mpeg-4 10 AVC_
    – T.Todua
    Commented Mar 16, 2017 at 11:14
  • Another disadvantage of multiple video streams in one file is (c) that it dramatically increases the filesize. To play one of the streams the player has to access the data for all of them at the same time.
    – stib
    Commented Mar 16, 2017 at 11:29
  • @T.Todua No idea. As I said, in my experience most applications aren't built to handle multiple video streams because in practice there's really no application for them. You should be able to build a file with multiple video streams with ffmpeg, but what is YouTube supposed to do with it? It doesn't even have an option to switch between multiple Audio streams, let alone Video streams ... just create two seperate videos and be done with it
    – MoritzLost
    Commented Mar 16, 2017 at 12:49
  • One application I think is storing footage from depth cameras (RGB-D). Synchronizing the two video tracks at a frame level could be tricky I suspect -- does .mkv support this?
    – thinkski
    Commented Aug 2, 2018 at 21:52
  • 1
    @T.Todua - This is much simpler than it looks. I have posted an answer with two cross-platform opensource tools. As for players, the most common ones (VLC) can handle the multi-video-stream files.
    – cipricus
    Commented Feb 8, 2021 at 10:01
1

This is certainly possible, and rather easy to do, for example with MKVToolnix, adding the second file as new source to current settings (just darg & drop the files)

enter image description here

enter image description here

Matroska video can handle multiple streams, and so can mp4. MKVToolnix gives only mkv as output I think. For various output formats a good tool is dmMediaConverter, which is less known but is a great ffmpeg frontend.

enter image description here


The output has the expected size of the two input sizes added up.

As for playing the resulting movie and switching between the video streams, VLC can do it, as well as Gnome Mpv (in Linux). SMPlayer was less good (sometimes jumped forward when switching or just crashed). MPV with pseudo-gui has no option for the switch. (Tested in Linux.)

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.