>Kurt,
>any news regarding the dog searchengine )?? Yep...
I created the site and sold it.
I used Article Ideas to spider sites for the top 25 most popular breeds. This takes some work, but it delivers the highest qualtiy results.
The time spent with this is mostly spent adding page titles to each, as Article Ideas doesnt' return a page title, and the results are in Fatty format.
Article ideas returns results like this, using only the URL and description:
http://dombom.com
This is some text from the page containing the keywords used.
So, by hand I added the keywords, in this case the breed of dog, plus the pipes and the word "info".
This gave me something like:
http://dombom.com|rottweiler info|
This is some text from the page containing the keywords used.
Notice the pipes BEFORE and AFTER |rottweiler info|.
I repeated this for each keyword (DOG BREED).
I took the entire page and it in the Linez Tuel.
I cropped lines at about 200 characters, as some of the Article Ideas results contain too much text and I don't want to steal a person's entire article.
Then, I clicked "join lines". Now, all the text is on a single line.
Next, I used the "add line breaks" feature:
Add line breake
BEFORE: http://
This put each site on it's own line and in Fatbomb format.
I then created about 1000 URLs to various keyword based SERPs to use with Spiderbomb.
I didn't want to bang away at Google and get my IP banned, so I split the searches up between the major SEs, including AOL, Yahoo and HotBomb. Aol uses Google results anyway...And I have a mixture.
I took the 1000 URLs and made 8 starting pages, with 125 URLs to SERPS each. And each of these pages used 6 different SEs, so I was only polling each SE about 21 times per page. And, I limited it to two pages a day, at different times of the day.
I downloaded the Spiderbomb results and pasted the date into Linez. I then cut lines containing "www.google.com", www.yahoo.com, etc. This removed all the SE BS.
I also used Linez in this way:
1. suffix each link with 12345
2. I then "cut" lines containing: |12345
3. I then did a search/replace to remove the 12345
What this did was remove any sites that didn't have descriptions.
Here's why...A line in Spiderbomb/Fatty format looks like this:
url|title|description
AFter adding 12345 to the end of each line, only lines without a description will look like this:
url|title|12345
The others will look like this:
url|title|description12345
As you can see, only lines without a description will contain the text string:
|12345
url|title|12345 (including the pipe!!!)
Here's how the lines with descriptions looked:
url|title|description12345
Lines WITH descriptions don't have a pipe before the 12345. So I "cut" them using this as the text:
|12345
It's pretty easy to do and it removes all the lines where a site doesn't have a description.
I uploaded the Article Ideas file and the Spiderbomb files and told Fatty where to find them.
I gave a much higher weight to the Article Ideas database, as it returns the highest quality results.
I also scraped all the dog related products from Clickbank and put them in a file. I don't remember the exact recipe, but I used Linez to clean them up and format them.
I gave the CB database just a little more weight than the Article Ideas database, but not much more...So in most cases CB stuff will get to the top of our SERPs.
I also included scraped results from OPD/DMOZ, which is open source, and it returned good results for this niche
In addition, I also included scraped results from Youtube.
I gave lower weight to these resources than the others.
I also added some Amazon books, using Bo Zon, BlogBomb, telling
FatBomb to include some pheeds. I staggard the update time in Blogbomb from updating the most popular keywords every couple of weeks, and the less popular keywords every couple of months. I did this so there won't be a "traffic jam" with BlogBomb updating 100 pheeds all at the same time...But often enough so the the Amazon products are "fresh".
In general, I weighted the sources in this order:
Clickbank
Article Ideas
Spiderbomb
Amazon dog related books
ODP
Youtube
This worked real well for the dog niche and returns some pretty good (and varied) results. Other niches may need different stuff using different weights.
Note: I bought resell rights to Article Ideas...I'll give it to Bombers pretty soon.
-Boom boom boom boom.