I added a little script today that puts affiliate datafeeds on your wordpress blogs.  It works with shareasale.

For our black hat members it’s in the “Scripts and Tools” from us section.

Well I started playing around with a software program called Xenu a few days ago.  I was looking for a way to spider any of my sites and grab the page title, and go deep into the site as well.

I broke out all the tricks I knew - and kept hitting a brick wall.  Since I run so many different “types” of sites I wasn’t getting the results I wanted.  To Google search I went.

I found this:

http://home.snafu.de/tilman/xenulink.html

It’s free, and it spits out a real nice tab deliminated text file for me with the link, and the title of the page.  So I started thinking about what I wanted to do with this.  My goal was to get lot’s of links to my sites….

Wordpress to the rescue

I’ve got some cleaning up to do with the code, but I’ll be adding it to the NSS 2 site shortly along with instructions.

Today I added a little scrapper script to NSS2.  It allows you to scrape articles from ezine articles, images from google images, and the youtube code for videos.

It by default pulls in 15 results for each thing based on a keyword.  You can increase this but if you overdo it at ezine articles they ban you.  I’ve found I can scrape a result set once an hour or so and have zero problems.  If I try and do 4 an hour  I usually don’t get much further.  I think about 50 pulls from ezine articles over a short time period and they catch you.

The structure is thus:

images  (the url the image came from)
images/gfx (The actual thumbnail of the image)

Articles (The article from ezine articles.  (H2 tags for the title, p tags for the body)

video (the embed code from youtube).

To add that content to the “foundation” sites in NSS2 you need to do a couple changes.

1.) Articles need to be reformated a tad.  The following code works for me:

Replace every closing p tag in the articles with this:

Replace:   </p>

With:        </p><p>&nbsp;</p>

I use a program called simple search and replace to do this.  It’s free and can be found with a quick google search.

Then you need to make three folders:

video
articles
rotateimage

The html files in the video and article files can just be moved over as is.  But you want to put the files in the images/gfx folder in the rotateimages folder.

Obviously you can use this for other things than the foundation sites.