Flushing after each packet goes belly up for E-AC3 tracks in which the core and the extension arrive in separate packets. There are M2TS files for which this is the case.