I heard they’ve fixed it, but it used to be limited to 100 songs, and it was a simple re-order and not actually random. It’d always put tracks in the same order (unless you’ve changed something in the first 100 tracks since last time)

You’d have a 300 song playlist, hit shuffle, and it’d “shuffle” the same 100 songs in the same order, but start at a different point every time.