All Questions
12 questions
0
votes
1
answer
139
views
Received server error (500) while deploying HuggingFace model on Sgaemaker
I've successfully fine tuned a sentence-transformers model all-MiniLM-L12-v2 on our data in SageMaker Studio and the model was saved in S3 as a model.tar.gaz.
I want to deploy this model for inference ...
- 1,505
0
votes
1
answer
173
views
Why aren't my metrics showing in SageMaker (CloudWatch)?
I'm training a S-BERT model in SageMaker, using Huggins Face library. I've followed the HF tutorials on how to define metrics to be tracked in the huggingface_estimator, yet when my model is done ...
- 1,505
1
vote
1
answer
70
views
How do I detach the HuggingFace SageMaker training?
I am training a HuggingFace model remotely on SageMaker integration. My training job takes more than two hours, and I would like to shut my computer off during training.
I use the following snippet to ...
- 3,636
0
votes
1
answer
371
views
Sagemaker downloads the training image every time it runs with Hugging Face
I am training my HuggingFace transformers model on SageMaker, that spins up an image each time I submit a job:
...
Training - Downloading the training image..............................
...
This ...
- 3,636
0
votes
1
answer
48
views
Adding ID to Text Output in AWS Batch Transform Job with DistilBERT Model
I have a dataset in JSON format with ‘id’ and ‘text’ columns. Currently, I’m using the following pipeline configuration in AWS:
hub = {
'HF_MODEL_ID':'distilbert-base-uncased',
'HF_TASK':'...
- 1
0
votes
0
answers
135
views
what's the best way to evaluate Helsinki model with the Huggingface Trainer
I am trying to finetune Helsinki model with the Huggingface trainer based on the documentation found under link 1 and link 2 for a translation task from German to French. I am using cross validation ...
- 73
1
vote
1
answer
2k
views
SageMaker complains that /opt/ml/model does not appear to have a file named config.json
I am using a huggingface model alongside a custom pipeline to deploy my model onto SageMaker, my model.tar.gz structure looks like below:
├── added_tokens.json
├── code
│ ├── inference.py
│ ├── ...
- 1,331
2
votes
0
answers
347
views
Discrepancies: Sagemaker vs. Local Hugging Face Model inference Results
I am using a Hugging Face model (sentence-transformers/distiluse-base-multilingual-cased-v2) on my local system to convert text into vectors.
class SequenceEncoder(object):
def __init__(self, ...
- 424
1
vote
0
answers
316
views
AttributeError: module 'torch.nn.init' has no attribute 'trunc_normal_' While saving trasnformer google/vit-base-patch16-224-in21k model to local
I am trying to save google/vit-base-patch16-224-in21k locally and then upload it to s3 for hosting this model in the SageMaker environment.
from transformers import AutoImageProcessor, ViTModel
# ...
- 2,001
2
votes
0
answers
370
views
ModelError when deploying a HuggingFace model in AWS SageMaker Endpoint
I'm trying to deploy a model using hugging face documentation in AWS SageMaker. I use the exact same code they are showing in their page:
from sagemaker.huggingface.model import HuggingFaceModel
# ...
- 53
0
votes
1
answer
267
views
Huggingface - Inference code in trainer script
I want to train a model for token classification using Huggingface Trainer and deploy it as an AWS Sagemaker endpoint. I followed this link and I am able to train and deploy the model using ...
- 410
0
votes
1
answer
637
views
Is it possible to perform local dev on a CPU-only machine on HF/sagemaker?
I'm trying to dev locally on sagemaker.huggingface.HuggingFace before moving to sagemaker for actual training. I set up a
HF_estimator = HuggingFace(entry_point='train.py', instance_type='local' ...)
...
- 5,636