Web Scraper in Go, similar to BeautifulSoup
-
Updated
Nov 2, 2023 - Go
#
webscraper
Here are 1,343 public repositories matching this topic...
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
html cli http json scraper web rest command-line curl xml webscraper wget css-selector xpath xquery data-processing httpie webscraping datascraping xmlstarlet
-
Updated
Apr 20, 2024 - Pascal
a class that uses scraped proxies to make http GET/POST requests (Python requests)
python http proxy proxy-requests webscraper proxy-server http-proxy python3 recursion requests proxy-list webscraping python-requests http-getter recursion-problem http-proxy-middleware http-get requests-module webscraper-api
-
Updated
Dec 3, 2020 - Python
An R web crawler and scraper
-
Updated
Mar 27, 2022 - R
Scalable Python web scraping scripts for +40 popular domains
python crawler scraper automation spider web-crawler scraping crawling webscraper proxies web-scraping webscraping twitter-scraper datascraping python-scraper captcha-bypass antibot scraping-python crawling-python web-scraping-python
-
Updated
Nov 21, 2024 - Python
An AI assistant tool that integrates coding, writing, and reading functions. For better alternatives see https://monica.im/desktop
electron react macos ai toolkit webscraper reading coding all-in-one xiaoai-tts chatgpt gpt-35-turbo
-
Updated
May 12, 2023 - TypeScript
Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object
python data-science data-mining csv pandas-dataframe webscraper pandas python3 data-analysis rightmove
-
Updated
Dec 27, 2023 - Python
Lego AI Parser is an open-source application that uses OpenAI to parse visible text of HTML elements.
python html parser machine-learning scraper tools ai parser-library parser-generator webscraper artificial-intelligence datascience webapp openai classification webscraping gpt-3
-
Updated
Jun 10, 2024 - Python
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-w…
crawler csharp dotnetcore scraping crawling webscraper scrapy entity-framework-core webcrawler webscraping scrapy-crawler ddd-architecture htmlagilitypack webcrawling webcrawler-htmlagilitypack
-
Updated
Dec 20, 2022 - C#
Web scrapper for Shutterstock
-
Updated
Nov 24, 2020 - Python
Financial Web Scraper & Sentiment Classifier
-
Updated
Oct 2, 2020 - Python
Scrapes g4g and creates PDF
-
Updated
May 15, 2020 - Python
Spotify Scraper to extract all the information from spotify, download mp3 with cover of the song
python crawler scraper webscraper python3 free webscraping spotify-downloader spotify-web-player spotfiy infromation spotify-scraper spotify-scraping spotify-crawler preview-mp3 album-title spotify-songs
-
Updated
Jun 20, 2024 - Python
Cryptocurrency Historical Market Data R Package
cran crypto webscraper financial kaggle cryptocurrency open-data dataset market-data cryptocurrencies coinmarketcap rpackage historical-cryptocurrency-prices
-
Updated
Nov 28, 2020 - R
A php crawler that finds emails on the internets
-
Updated
May 20, 2021 - PHP
A Python command-line tool for scraping and downloading subtitles from AppleTV and iTunes movie pages.
-
Updated
Jul 7, 2024 - Python
An automated, programming-free web scraper for interactive sites
-
Updated
Jul 6, 2023 - HTML
Automated Python Script to retrieve vaccine slots availability and get notified when a slot is available.
python json automation notifier webscraper python3 webscraping vaccination coronavirus covid-19 covid covid19 vaccine-tracker vaccine-availability cowin cowin-vaccine-tracker cowin-alerts cowin-notifier
-
Updated
Jan 30, 2022 - Python
Improve this page
Add a description, image, and links to the webscraper topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the webscraper topic, visit your repo's landing page and select "manage topics."