"Ah, scraping is a no no when it come to joomla.org.
So I removed the JED Reviews from my site."
George Law's Page
Latest Activity
Peter van Westen (NoNumber) commented on George Law's blog post Joomla Web Scraper Plugin - Request for Comments
Norm Douglas commented on George Law's blog post Joomla Web Scraper Plugin - Request for Comments"Sounds like a really cool and interesting idea... similar to sheep cloning. Question is, should we be doing this?"
Peter van Westen (NoNumber) commented on George Law's blog post Joomla Web Scraper Plugin - Request for Comments"I have some scraping stuff going on on my own website. For retrieving positions in the JED top rated list. And to show all the JED reviews on my extension pages.
I think the latter would at leat be something that could be handled through your…"
Stian Didriksen commented on George Law's blog post Joomla Web Scraper Plugin - Request for Comments"Holy shit! phpQuery is out yet? How did that slip by my radar!!
Pursue it, it's the perfect tool for the situations where the fetched content is formatted beyond your control.
For stuff like cross domain ajax, a plugin like that makes it…"
Miljan Vujosevic commented on George Law's blog post Joomla Web Scraper Plugin - Request for Comments"Yes it is worth it to pursue. As Amy sad, that's got a lot of potential.
Plenty people asked me for this kind of extensions. Over 70% of them ar asking because of scraping sport results and news, but honestly it has such potential that i would…"
"Boy, that's got a lot of potential, I think. To enable users to be able to retrieve site content using a Plugin certainly puts this capability into non-technical people's hands. When I was still with the University, I sat in on a…"
George Law replied to Amy Stephen's discussion Introductions"I am originally from Upstate NY (Syracuse), USA, now living in the Greenville, SC area.
I have been doing the whole L.A.M.P. thing for over 12 years - Linux Sys Admin, MySQL DBA, Apache, Perl, PHP, etc...
I started using Joomla in the spring of…"
"Here you are! Thanks for joining in! It's good to have your involvement and I encourage you to open discussion on topics of interest. Look forward to learning more about Joomla! development right along side you."
George Law posted a blog postJoomla Web Scraper Plugin - Request for Comments
After recently helping a guy out on twitter with a web scraping project, the thought occurred to me that there might be a need for the same type of processing in Joomla.His initial request came in regarding a word press plugin that I could never get working right, but it turned me on to the phpQuery library which works well at parsing HTML.Generally, most of the custom code I am writing in Joomla is done either in a template override fashion, with Jumi or Sourcer, or hacking the core Joomla…See More
Profile Information
- Please share a bit about your Joomla! Experience and yourself. The more information you provide the quicker we will be able to process your membership.
- Developing Joomla for general all purpose websites for over 2 years now.
- Business Web site
- http://viewdm.com
George Law's Blog
Joomla Web Scraper Plugin - Request for Comments
After recently helping a guy out on twitter with a web scraping project, the thought occurred to me that there might be a need for the same type of processing in Joomla.
His initial request came in regarding a word press plugin that I could never get working right, but it turned me on to the phpQuery library which works well at parsing HTML.
Generally, most of the custom code I am writing in Joomla is done either in a template override fashion, with Jumi or Sourcer, or… Continue
His initial request came in regarding a word press plugin that I could never get working right, but it turned me on to the phpQuery library which works well at parsing HTML.
Generally, most of the custom code I am writing in Joomla is done either in a template override fashion, with Jumi or Sourcer, or… Continue
Posted on September 28, 2009 at 12:01am — 6 Comments
Comment Wall (1 comment)
- At 12:20am on September 28, 2009,
Amy Stephen said…
- Here you are! Thanks for joining in! It's good to have your involvement and I encourage you to open discussion on topics of interest. Look forward to learning more about Joomla! development right along side you.
© 2012 Created by Amy Stephen.
