I think rclone has somewhat bad latency, at least from prior experience (albeit with Google Drive). JuiceFS seems to cache locally and can run my Immich instance, etc. With pretty good performance

True, but S3 offers you extremely high availability and security for a quite fair price, and not everyone wants to immediately self host on their own hardware.