All Questions
18 questions
0
votes
0
answers
69
views
Why am I not able to load and use below spacy pipeline properly?
I used available pipeline enn_core_web_lg and added concise_concepts in the pipeline, with some dummy NER data. Immediately after that if i try NER, it works. But when i try to save the whole thing ...
- 95
0
votes
2
answers
229
views
How to configure the page number in the gcp document ai toolbox converter?
I am trying to include the page number in the configuration JSON. I tried some ways, but no one works. Looking at the converter code on the GitHub page, I saw a lot of mentions of "page_number&...
0
votes
1
answer
151
views
Parsing user query with NLP to identify entities, typos and attributes and running a search on elasticsearch
Hello StackOverflowers,
I have hundreds of thousands of documents in the following structure. I can modify the document before loading it into Elasticsearch, like adding vectors, synonyms or other ...
0
votes
0
answers
2k
views
TypeError: __init__() got an unexpected keyword argument 'has_model_config' while training Token classification model
System Info
transformers version: 4.18.1
Platform: Linux Jupyter Notebook, TF2.3 Python 3.6, 2 GPU
Python version: '1.7.1+cu101'
Using GPU in script?: yes
Using distributed or parallel set-up in ...
- 1,505
0
votes
1
answer
268
views
Training CamelBERT model for token classification
I am trying to use a huggingface model (CamelBERT) for token classification using ANERCorp Dataset. I fed the training set from ANERCorp to train the model, but I am getting the following error.
Error:...
- 3
0
votes
1
answer
488
views
Why FLAIR does't recognize the entire location name of simple sentence?
I'm tying to to detect simple location with NER algorithm, and I'm getting semi-correct results:
from flair.data import Sentence
from flair.models import SequenceTagger
tagger = SequenceTagger....
- 4,780
1
vote
1
answer
759
views
How to extract relation between entities for stock prediction
I am trying to extract relation between two entities (entity1- relation- entity2) from news articles for stock prediction. I have used NER for entity extraction. It would be great if anyone could help ...
1
vote
1
answer
218
views
How to build 'ner_ontonotes_bert_mult' model from scratch
How can I custom train the model "ner_ontonotes_bert_mult". I want to train the model with my own dataset which have some different tags. How to train the model and use it?
When I am ...
- 41
1
vote
1
answer
155
views
'ner_ontonotes_bert_mult' model Custom train
When I want to train this 'ner_ontonotes_bert_mult' model with my custom dataset it is showing the error below. (I have saved my datset in the ~\.deeppavlov\downloads\ontonotes folder that was ...
- 41
4
votes
1
answer
578
views
NER tagging schema for non-contiguous tokens
The most common tagging procedure for NER is IOB. But it seems that this kind of tagging is limited to cases where tokens from the same entity are contiguous.
So for instance,
Jane Smith is walking in ...
- 315
1
vote
1
answer
659
views
How to use ELMO Embeddings as the First Embedding Layer in tf 2.0 Keras using tf-hub?
I am trying to build a NER model in Keras using ELMO Embeddings. SO I stumped across this tutorial and started implementing. I got lots of errors and some of them are as:
import tensorflow as tf
...
- 4,132
3
votes
0
answers
2k
views
AttributeError: 'Tensor' object has no attribute '_keras_history' using CRF
I know there are a bunch of questions on this problem and I have read some of those but none of them worked for me.
I am trying to build a model with the following architecture:
The code is as ...
- 420
1
vote
1
answer
3k
views
Data preprocessing for Named Entity Recognition?
I'm working on a Named Entity Recognition on resume dataset and we have entities like dates, phone, email etc.,,
And I'm working how to preprocess those entities. I'm currently adding a space after ...
- 2,119
2
votes
1
answer
671
views
How to use k-means algorithm to do attribute clustering after NER?
I am reading this paper and in 3.2.1 sub-section, first paragraph last three lines,
To map the named entity candidates to the
standard attribute names, we employed the k-means algorithm to ...
- 2,119
7
votes
3
answers
6k
views
How to get probability of prediction per entity from Spacy NER model?
I used this official example code to train a NER model from scratch using my own training samples.
When I predict using this model on new text, I want to get the probability of prediction of each ...
- 8,824
0
votes
2
answers
1k
views
How to train completely new entities instead of pre-trained entities using Spacy NER model?
How do I do transfer learning i.e. take pre-trained Spacy NER model and make it learn new entities specific to my use case?
For this, I have 100 new annotated training samples. The new retrained ...
- 8,824
1
vote
1
answer
210
views
Clarification on the use of Vocab file in NER
I am learning Named Entity Recognition, and i see that the training script uses a variable called vocab which looks like this
vocab = "0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ\'...
- 10.1k
1
vote
1
answer
202
views
Runnig DeepPavlov Named Entity Recognition
How I can run NER from DeepPavlov?
I have an input file with sentences "sentences.txt" and need to put results in "result.txt".
- 23