Can there be a reliable answer?
As with almost everything is video. The real answer is: It depends.
With mp4, the moov must be at the beginning, AND the mdat must properly interleave tracks. For example, If the there more than one megabyte of audio before the video, Then it won't work even with the moov at the start.
For TS, there must be a SPS, a PPS ...