It would be great for PDL to supply pre-trained embeddings for Sagemaker.
There are several great models available on Sagemaker directly.
This is an example of a custom model a lot of people use: https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2