If you are trying to “teach” the model new information, embeddings is the way to go. If you want to change the structure or way it response, then use fine-tuning.
Fine-tuning: Teach the model how to answer a question (e.g. structure/format, personality, etc)
Embedding: Provide the model with new/specific information with which to answer questions.