FineTuning on SageMaker
#82
by dshah3 - opened
Hi, I have a set of p4 (A100) instances available through Sagemaker training jobs. I would like to finetune StarCoder on a function summarization task. Would I be able to use the HuggingFace "Train" SageMaker interface and the Transformers library to run a fine-tuning job? Or would I have to use the fine-tuning script in the GitHub library and adapt it to run on SageMaker?
I am trying to achieve something similar? any guidelines @loubnabnl ?
If you were successful, please suggest the steps. I am new to it and would like to finetune the model. Also would like to have some helps to understanding the format of test data