This reverts commit f29c19be5821d26a6b7682d0c69ff31d0815e072. If this is called for the reference context then we would run into an infinite loop, which is not really better than an assertion. By fixing up DTS to never be ahead of the PTS in the previous commit this situation should be impossible to hit now. Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/4498>