All Questions
Tagged with rss feedparser
151 questions
-1
votes
1
answer
154
views
Correctly sort RSS items by time
I'm getting RSS items from different RSS channels. And I'd like to sort them correctly by time and take into account the time zone, from the latests to the oldests. So far, I have the following code:
...
- 4,190
0
votes
0
answers
29
views
Python Feedparser Not Showing Entries
I've watched a lot of videos about feedparser library in tutorials everybody use this library like in my code but my code is not working... Anyone help me? my code
I still can't get output even though ...
- 1
1
vote
1
answer
2k
views
Using Python to get Substack posts without scraping
I want to create a dataframe of Substack posts from all the newsletter I subscribe to. But using feedparser + Substack's RSS feeds only seem to go back ~20 posts—even if a particular newsletter has ...
- 968
-1
votes
1
answer
51
views
Why is my pythonscript breaking after hours of working fine?
I wrote a small simple program which checks the RSS feed of a german news site, saves the pubDate, title, description and link of the last article and saves it to a txt file. After running over 11 ...
-1
votes
1
answer
104
views
Feedparser not returning values, only metadata
I'm using feedparser to get info from a public database (https://knesset.gov.il/Odata/ParliamentInfo.svc/KNS_Bill()).
Each of my entries looks as follows
When accessing specific properties:
url = '...
- 1
2
votes
1
answer
3k
views
How to use an rss feed in python?
I have never worked with an RSS feed before, I can't seem to find the url of the feed.
The page which is offering the RSS Feed:
https://www.sec.gov/edgar/browse/?CIK=717826&owner=exclude
I am ...
- 4,035
1
vote
1
answer
92
views
How to create Article tags from splitting the Title in Django
I want to create articles tags from the title of a RSS feed post. Then save the tags into a DB with a post_id of the title i got the tags from at the same time. Something like this:
Title = "...
- 153
1
vote
1
answer
730
views
Cannot get thumbnail in rss feed in laravel
I am using willvincent feed reader to parse rss feeds, But i cannot seem to get the thumbail of the images,
Here is my code
Route::get('feed', function(Request $request) {
$f = FeedsFacade::make('...
- 73
2
votes
4
answers
303
views
Accessing duplicate feed tags using feedparser
I'm trying to parse this feed: https://feeds.podcastmirror.com/dudesanddadspodcast
The channel section has two entries for podcast:person
<podcast:person role="host" img="https://...
- 8,714
0
votes
1
answer
175
views
Feedparser not parsing email body properly
I'm trying to parse the below (which came from a gmail email body) using feedparser by feeding it in as a raw text feed. I'll be displaying it on a page so I want it to look like it did in the email ...
- 179
1
vote
0
answers
123
views
How can I serve a modified version of an RSS feed?
The problem: I use inoreader.com to monitor a set of RSS feeds. Each of the feeds is generated by pubmed.gov and contains academic journal articles. But there is an annoying quirk where pubmed encodes ...
- 4,667
0
votes
1
answer
444
views
Import RSS with FeedParser and Get Both Posts and General Information to Single Pandas DataFrame
I am working on as a python novice on an exercise to practice importing data in python. Eventually I want to analyze data from different podcasts (infos on the podcasts itself and every episode) by ...
- 31
3
votes
1
answer
411
views
Extract value from a list formatted like a JSON file in Python
I have a function that returns an image URL from an RSS feed (I'm using feedparser). The problem is that it returns a strange formatted list.
My feed has a key called media_content. The code used to ...
- 125
1
vote
1
answer
218
views
Feedparser, no etag and modified attributes
How could I know if the feed has changed since last check if none of these attributes exists for a given feed ?
Example with this one from a nintendo news website:
d=feedparser.parse('https://www....
- 274
0
votes
2
answers
2k
views
How to update RSS Feed every 5 seconds in Python using Flask
I did a lot of research and nothing relevant worked. Basically I am trying to scrape RSS Feed and populate the data in a table format on a webpage created using Python Flask. I have scraped the data ...
- 21
1
vote
1
answer
187
views
Output of feedparser in python unexpectedly truncated
I'm writing a piece of code that parses information from an RSS feed. I am storing the parsed informations for later research. In the case at hand I'd like to store info such as [Name, Surname, Type ...
- 11
0
votes
0
answers
296
views
Python Feedparser pubdate to one timezone
I need to parse RSS feed. I am using feedparser on python. Basically my task is to run script every N seconds and check for last feed. I come up with idea to check is date is younger than 15 seconds ...
- 187
0
votes
1
answer
212
views
Issue while using python rss feed with feedparser
I am trying to get the data from a rss feed using python 3.7.7 and feedparser.
I am able to get the simple information like feed['title'] but I am unable to get feed['ht:approx_traffic'] which is one ...
- 1,495
1
vote
1
answer
1k
views
How to detect with feedparser if there are new items in an RSS channel?
I have the following code. When you understand the code, you can look at the two comments with
the capital letters. I could test if there are new items in the channel with insert or ignore but
I'm ...
- 4,190
0
votes
1
answer
56
views
Trouble with parsing, target contains a hyphen
I'm trying to get some information from an RSS feed, more specifically the data contained in the "filing-type" section. However the section contains a hyphen and so when i run the code:
import ...
0
votes
1
answer
81
views
Extracting a substring from XML element
I am trying to extract the 'Abstract' substring from the 'Description' elements of an XML RSS feed. Code snippet:
import feedparser
rss = 'https://eutils.ncbi.nlm.nih.gov/entrez/eutils/erss.cgi?...
- 55
0
votes
1
answer
368
views
Feedparser not parsing searched for description
I'm trying to utilize RSS to get auto notifications for specific security vulnerabilities i may be concerned with. I have gotten it functional for searching for keywords in the title and url of feed ...
1
vote
0
answers
436
views
How to check / reload automaticaly rss feed with feedparser?
I started to get interested in python and feedparser. I would like to know how to get the new entries of an rss automatically without having to restart the script to get the new entries.
When there ...
- 11
17
votes
3
answers
32k
views
How to build a simple RSS reader in Python 3.7?
I built a simple RSS reader on Python and it is not working.
In addition, I want to get the featured image source link of every post and I didn't find a way to do so.
it shows me the Error: ...
- 223
2
votes
1
answer
2k
views
Get new items from rss feed
I am using python feedparser to parse some rss feeds(every 2 hours), unfortunately the rss feeds do not contain etag or modified values and therefore whenever I parse the feeds I get the entire data ...
- 1,364
-1
votes
1
answer
2k
views
How do I access the image and image url in an RSS feed using Python?
I currently have this code in Python using feedparser:
import feedparser
RSS_FEEDS = {'cnn': 'http://rss.cnn.com/rss/edition.rss'}
def get_news_test(publication="cnn"):
feed = feedparser....
- 111
1
vote
2
answers
948
views
feedparser for reddit returning empty
I am trying to use feedparser with python to fetch the most recent posts from a sub_reddit.
I have the code below but it is not returning anything when I run it.
import feedparser
feed = ...
- 777
1
vote
1
answer
483
views
How can I handle index when reading from stdin [duplicate]
I'm working with bash scripts and would like to embed a Python snippet inside a bash function.
So I got this working Python snippet, which simply reads from stdin and parse it to get the title of the ...
- 164
2
votes
1
answer
394
views
Unexpected error when using feedparser.py
I have had great success parsing RSS feeds from the National Hurricane Center using the feedparser module:
import feedparser
feedparser.parse('https://www.nhc.noaa.gov/gis-at.xml') #Works Fine
...
1
vote
2
answers
537
views
Identify itunes:keywords and itunes:category individually with feedparser?
I'm using feedparser to parse rss feeds such as https://www.relay.fm/analogue/feed and can't work out how explicitly identify the itunes:category values.
Looking at the feedparser itunes tests it ...
- 3,449
0
votes
1
answer
71
views
Feedparser only returns number not the entire URL
I am using a simple Python script to retrieve the latest RSS info
# RSS read
d = feedparser.parse("http://rss.kicker.de/news/wm")
### (1) Last RSS Feed
url = d.entries[1].id
It works fine as in ...
0
votes
1
answer
148
views
Issues in time delay for RSS feed on full screen clock python
I have designed a full-screen clock for my Raspberry Pi 3 Model B which runs on Raspbian but can also run on Windows. The whole point of the clock is to show the date, time, and a RSS feed on r/news (...
- 1,661
0
votes
1
answer
6k
views
sys.argv list index out of range error [duplicate]
I am trying to run this script that grabs rss feeds on the environment "Thonny" but I just keep receiving this error of "IndexError: List index out of range"
Traceback (most recent call last):
File "...
0
votes
0
answers
664
views
How to use Feedparser in Django Project
Could anyone direct me on how to include feedparser in my Django project? Essentially I'm building a news aggregator, so there will be 100's of rss feeds to parse through.
I understand the basic ...
- 63
0
votes
1
answer
579
views
Python feedparser module error
python feedparser not parsing . "it gives me error that object has no attribute image."
rss feed:
thenews = 'https://www.thenews.com.pk/rss/1/1'
this does not work:
d = feedparser.parse(thenews)
...
- 409
4
votes
1
answer
2k
views
Python feedparser not returning any entries
I've been cycling through RSS feeds over the past week using feedparser. When using it today, my entire program fails to function and I've noticed that the error seems to be at the start of the ...
- 185
1
vote
0
answers
81
views
UnicodeEncode error in the process of inserting RSS data into the Mysql database
I am currently working on personal project that make news aggregator.
For that, i collected some sources about articles from some sites using Python feedparser lib. Following codes are functions of my ...
- 147
0
votes
1
answer
119
views
Python: Download/parse *Solely* the pubdate tag of rss entry
how do I download only the specific attribute of a metadata of an rss? I'm using the universal feedparser library
feedparser.parse(linkstr).entries[0].published
I have this line, which returns ...
- 9
0
votes
0
answers
166
views
Get exception when just started py script, but all work
Interesting situation!
I has parser.py script, link to it below in 1, with feedparser library.
When i just started it, i get such exceptions:
Connected to pydev debugger (build 172.3757.67)
pydev ...
- 337
0
votes
1
answer
960
views
Parse Stackoverflow RSS job feed for same name elements, with Feedparser in Python
Every job item on the Stackoverflow RSS feed has certain tags, with the key "category".
Looking basically like this:
<category>scala</category>
<category>hadoop</category>
&...
- 687
0
votes
1
answer
694
views
Feedparser returns a SAXParseException
I try to read RSS feeds using python. I use feedparser, and it works well for every feed, except one : https://www.frenchweb.fr/feed
import feedparser
feed = feedparser.parse("https://www.frenchweb....
- 411
0
votes
1
answer
64
views
Python and Comparing File Changes
d = feedparser.parse('somerssfeed/rss.xml')
message = {}
smessage = {}
for post in d.entries:
message[post.link] = post.title
fwrite = open("db.txt", "a")
for k, v in message.items():
if k ...
- 821
0
votes
0
answers
435
views
Script for FeedPaser to Regularly Gather RSS, then Storing Data in Database
I'm learning Python. To teach myself I've decided to try to build a tool which gathers RSS feeds and stores the output, title, URL and Summary in a database (I will later build a tool to access the ...
- 970
2
votes
2
answers
5k
views
How to parse a xml feed using feed parser python?
Im trying to parse a feed in python using feedparser. But all I get is None returned. Im not sure what im missing. Here is my code:
import feedparser
def rss(self):
rss = 'https://news.google....
- 1,437
2
votes
1
answer
998
views
Feedparser SAXParseException, bozo:1
I'm using feedparser in a script that's generally working for RSS URLs, but there's one URL that's giving me a headache: tabbforum.com/feed.atom
I get a SAXParseException('not well-formed (invalid ...
- 1,698
0
votes
1
answer
2k
views
Parse multiple RSS feeds (Python)
Using Feedparser to parse multiple RSS feeds but this function doesn't work. How can I create a function to parse feeds and get the link out of the feed entry to further push to a tweet?
def get():
...
1
vote
0
answers
164
views
Feedparser Missing Elements in MRSS Feed
I'm trying to parse an MRSS feed that has video entries and some metadata for those videos. Here is one entry:
<item>
<title>Harry Potter and the Sorcerers Stone</title>
<...
- 658
1
vote
0
answers
123
views
Not able to store media title using python feedparser
I a trying to store feeds from a website using feedparser, but the problem is in xml format each media-content has a media -title in it but while parsing using python feedparser library i can't get ...
- 995
1
vote
0
answers
2k
views
Python - Constantly monitor RSS feed (feedparser)
I'm trying to figure out how to 'subscribe', or constantly monitor an RSS feed (Python 2.7, using feedparser).
The website I'm looking at is DTCC, at the "RSS Feed for Credits".
When you download ...
- 3,521
2
votes
0
answers
405
views
Checking updates for rss feed every minute using etags
This is the code I am using for checking RSS feed updates. I am storing the last modified and etag of the feed in variables . whenever there is an update i am updating these 2 variables and rechecking ...
- 308