Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
1 answer
239 views

How can I make my Hugging Face fine-tuned model's config.json file reference a specific revision/commit from the original pretrained model?

I uploaded this model: https://huggingface.co/pamessina/CXRFE, which is a fine-tuned version of this model: https://huggingface.co/microsoft/BiomedVLP-CXR-BERT-specialized Unfortunately, CXR-BERT-...
Pablo Messina's user avatar
0 votes
0 answers
1k views

How to Load an Already Instantiated Hugging Face Model into vLLM for Inference?

I am working on a project where I need to utilize a model that has already been loaded and instantiated on the GPU using Hugging Face's Transformers library. The goal is to pass this loaded model into ...
Charlie Parker's user avatar
0 votes
0 answers
2k views

huggingface_hub.utils._errors.LocalEntryNotFoundError

The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/pangchongwen/anaconda3/envs/chatglm3/bin/huggingface-cli", line 8, in sys....
Phantom Pang's user avatar
0 votes
0 answers
368 views

OSError: Can't load tokenizer for 'model'. If you are trying from 'https://huggingface.co', make sure you don't have a local repo with the same name

OSError: Can't load tokenizer for 'AniketArtani/deploytest'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. ...
Aniket Artani's user avatar
2 votes
1 answer
2k views

Convert PyTorch Model to Hugging Face model

I have looked at a lot resources but I still have issues trying to convert a PyTorch model to a hugging face model format. I ultimately want to be able to use inference API with my custom model. I ...
Zeke John's user avatar
  • 127
0 votes
1 answer
48 views

Adding ID to Text Output in AWS Batch Transform Job with DistilBERT Model

I have a dataset in JSON format with ‘id’ and ‘text’ columns. Currently, I’m using the following pipeline configuration in AWS: hub = { 'HF_MODEL_ID':'distilbert-base-uncased', 'HF_TASK':'...
nana1vo's user avatar
6 votes
2 answers
5k views

How to Merge Fine-tuned Adapter and Pretrained Model in Hugging Face Transformers and Push to Hub?

I have fine-tuned the Llama-2 model following the llama-recipes repository's tutorial. Currently, I have the pretrained model and fine-tuned adapter stored in two separate directories as follows: ...
Aun Zaidi's user avatar
  • 315
1 vote
0 answers
2k views

ConnectionError: HTTPSConnectionPool(host='cdn-lfs.huggingface.co', port=443): Read timed out

While running the code, model stops loading in between and gives the following error. from getpass import getpass import os HUGGINGFACE_API_TOKEN = getpass() os.environ[...
Rishabh Gupta's user avatar
0 votes
1 answer
2k views

How does one create a pytorch data loader with a custom hugging face data set without having errors?

Currently my custom data set gives None indices in the data loader, but NOT in the pure data set. When I wrap it in pytorch data loader it fails. Code is in colab but will put it here in case colab ...
Charlie Parker's user avatar
4 votes
2 answers
2k views

Using a custom trained huggingface tokenizer

I’ve trained a custom tokenizer using a custom dataset using this code that’s on the documentation. Is there a method for me to add this tokenizer to the hub and to use it as the other tokenizers by ...
Dagim Ashenafi's user avatar