Thanks for writing this. It's a nice read.
I'm curious about this highlighted part. How did you configure the transfer job? Did you use transfer via URL list? Feel free to also DM me at firstname.lastname@example.org
ps - I'm a Product Manager in the Storage Transfer Service team.