WP Web Scraper

Screenshots

An easy to implement web data extractor for WordPress. This plugin can be used to display realtime data from any websites directly into your posts, pages or sidebar. It temporarily caches the content on your website. You can use this plugin to include realtime stock quotes, cricket or soccer scores or any other generic content from public domains. Important Note: Web scraping is a practice of extracting data from another website. When doing so, you need to ensure that you have the permissions to use the content, and you need to give due credit to the original source. Make sure when scraping content, you do not violate any copyright laws. Features include: Scraped output can be displayed through custom template tag, shortcode in page, post and sidebar (through a text widget). Configurable caching of scraped data. Cache timeout can be defined in minutes for every scraped data. Configurable Useragent for your scraper can be set for every scrape. Configurable default settings like enabling, useragent, timeout, caching, error handling. Multiple ways to query content – CSS Selector, XPath or Regex. A wide range of arguments for parsing content. Option to pass post arguments to a URL to be scraped. Dynamic conversion of scraped content to specified character encoding to scrape data from a site using different charset. Create scraped pages on the fly using dynamic generation of URLs to scrape or post arguments based on your page’s get or post arguments. Callback function for advanced parsing of scraped data. Check the the official website wp-ws.net for documentation, browse through examples, or try paid support for crafting a perfectly optimized web scraper. Documentation Arguments API Query – CSS Selectors, XPath and Regex Dynamic URL and headers Callback Functions Examples Example code for some common use cases of the plugin