You Have Full Total Control Over All
The Explosive Features of SpiderBomb
Web Admin: Easy and
Powerful
Main Control Panel
Example
(Not functional)
Status
Page Example
(Not functional)
Starting URL: You tell SpiderBomb
EXACTLY where to start, giving you supreme control over the subjects of your
data.
Output File: Lets you easily use
an already existing list of links, or creates entirely new databases.
If Output File Exists: SpiderBomb
gives you two choices: Overwrite or Append . If you've already created a
database of links, you can either "start from scratch", erasing your old
data and building a database of freshly indexed content, or you can add to
an existing file, building an ever-larger supply of content.
Include URL's Only from Domains: You
can limit which domains you want to include. This is great for building a
site map of your pages. And if you have more than one website, since you
can enter a number of domains, you can even include all of your domains.
Exclude URL's from Domains: You
also have the control to not include what ever domain you want. Maybe
it's your "evil competition" or a domain is giving irrelevant results, it's
your party and you're the one sending out the invitations.
Respect Robots Rules: Yes No
Be a good Net Citizen. Some webmasters don't want their pages indexed by
search engines for a variety of reasons. SpiderBomb has the option to respect
respect or ignore webmaster's requests. Please note: The only reason you
should EVER NOT respect the NO ROBOTS is WITH YOUR OWN PAGES, or from
those you have permission.
Follow CGI Queries: Yes No SpiderBomb
gives you the ability to include or ignore dynamic pages, just set "Follow
CGI Queries" to "yes or no". Note: Be sure to limit total number of requests,
as you don't want to get into a never ending "loop". The default of 10,000
is probably fine in most cases.
Depth Limit: 1 - 10 levels
This tells SpiderBomb how "deep" you want to crawl pages. Simply, find links
on this page, follow links found here, then follow links found there, then
follow those even further...The "deeper" you crawl, the more results you
will find. However, your results will also tend to be less relevant. However,
if you're spidering your own sites, set it to the "max".
Max. Number of Results: This is
the total number of links that you've spidered that you want included this
session. If you're on a discount hosting service, this is one way to limit
SpiderBomb.
Max. Number of Requests: This
is the total number of times you want to "crawl" or visit web pages. This
isn't always the same as "Results" because some pages that SpiderBomb visits
won't be indexed due to Robots.Txt, you've entered the domain in the "exclude"
form, etc.
Max. Number of Parallel Requests:
SpiderBomb gives you the power to visit more than one page at a time.
The higher you set this, the faster you can index pages. Warning: The higher
you set this, the more server power you will need.
Max. CPU Time (seconds): This
let's you control exactly how much of the server's CPU you use. These allows
extreme control for a wide range of hosting solutions. Please note that each
host has its own quota.
Max. Absolute Time (seconds): This
is the "elapsed time", or how much "real time" has gone by since you started
the last session.
Delay Between Requests (seconds):
It is proper ettiquette to not just "pound away" at other's webpages, sucking
in data (and their resources) as fast as you can. Plus, you can be more "polite"
to your own server, by using a delay in your requests. Of course, if the
situation warrants it, you can always set this option to "0", which will
give you the fastest results.
Password Protected Admin
Protects you and your data.
Be Legal...
Indexes Websites Instead of Stealing Content-There are some programs that
merely go to a search engine and copy its search results. Using the exact
searches and in the same order is probably illegal, and at the least immoral.
SpiderBomb doesn't steal content. It uses "starting points" you define, then
wanders the web collecting data. This is exactly what Google, Inktomi and
others do, and it is how SpiderBomb collects data. Note: It's rumored that
Google may use ODP as its "starting point".
Be Respectful...
Uses Title tags and Meta Description Tags-After SpiderBomb visits a page,
it will extract each pages' Title and Meta Descriptions, and use these for
your search results. It is traditional on the web that the purpose of these
two tags are for the use of other sites as a means to describe their pages.
By using the Title and Meta Description of each page, you are respecting
the wishes of each webmaster.
Be Honest...Spiderbomb content
pages don't need to hide links or play other search engine tricks.
More Uses:
Create Site Maps-Just set Spiderbomb
to include only links from your domain(s) and it will create a site map just
for you. Site maps increase your usablility, as well as greatly increasing
your ability to get indexed by the major engines.
Spy On Your Competition- Discover
your competition's link strategy, hidden pages, external links and
more...
Check your "Indexabiliity Ability"-
Can't get in the engines? Use Spiderbomb to find your pages. If SpiderBomb
can't find them, then chances are, no one can.
Perl Modules Built In-All required
perl modules are included so you don't need to ask your host if they have
them installed.
Fast and Easy Installation-Merely
upload a few files, set the permissions of the folders to 777 and spider.cgi
to 755 and you're ready to go.
Sample Pages:
Plain-Check
this page out for speed. Hit refresh a couple of times to see how fast this
dynamic content loads.
Template-The
same content as above, but inserted in a custom web design.
|
SpiderBomb is a new explosive
cgi/perl program that gives you the same powerful resources that many
of the web's biggest and most successful sites have exploited almost since
the creation of the Web.
SpiderBomb builds free data for you that
you can use on your site by finding sites on the web and spidering links
on the pages it finds.
But not only does SpiderBomb spider links,
it will also "crawl" pages, so it can find more links, then crawl and index
more pages, then find more links and so on, it's up to you how long and far
SpiderBomb will travel in its quest for data....
Exploiting SpiderBomb's fullest potential
empowers you to have access to the same business models as many of the web's
"Super Sites".
Exactly what business models do the biggest
sites on the web use? Why don't we think about this for just a second....
If you do a search at Google for only:
http:// the common theory is that Google will use its PageRank to
determine the most "powerful" webpages, since all websites share
http://
Here's the results for the same Google
search for http://
Google
Results for: http://
You'll probably agree that the top ten
sites listed are among the most powerful and popular sites on the web.
On May 23 2003, six of the top ten
sites delivered by this Google search all had the same business model.
These six websites: Yahoo!, Google,
Alta Vista, Excite, Go.com (Infoseek.com) and Lycos all use the identical
recipe for their content and revenue, mixing these three elements:
-
Targeted Pay Per Click type links
to generate revenue. Google uses their own adwords, while Yahoo and some
of the others use Overture.
-
A human inspected "index" of links
such as Yahoo's directory. Many, such as Google use the Open Directory Project
as their index.
-
Spidered links. As you may know,
some of these engines supply spidered results for other search engines. For
example, Google's spidered data is shown for results on both America Online's
search and as the main search for Yahoo! Having your own spidered links seems
like a very good idea, if you consider the successes of the sites mentioned.
Spidering AND crawling websites for FREE
content you can use on your site is exactly what SpiderBomb does for you,
just like the "big boys" use spiders to find sites. This free content acts
as the very basis of their entire sites. It's what their site "is"...Spiders
find relevant links to other sites, which is the content that brings visitors,
and these visitors generate revenue by clicking on relevant pay per click
links (sponsored) .
Do you know any Internet Marketing guru
that's made as much money as any of these six sites? Instead of listening
to what some experts say, maybe we should just do want the big boys are doing,
but not telling us about.
And this is what SpiderBomb does for
you. It finds and creates your own original database full of
content.
We both know we can't compete with Yahoo
or Google on an Internet-wide basis. I doubt either of us has the resources.
It's rumored Google has over 10,000 servers. You may share a server with
1000 other sites...
SpiderBomb is engineered for the little
"guys and gals" to give a webmaster with limited resources a tool that
can help find and create content in the same manner as the major
engines.
SpiderBomb is not meant to be used to
spider and crawl sites 24 hours a day, seven days a week, building a huge
database of links. That's already being done and you probably don't have
10,000 dedicated servers to handle it.
It is designed to be as "host friendly"
as possible, running in short bursts, and monitored by you. Although, if
you have a dedicated server, you can go "full throttle" by increasing the
number of "Parallel Requests" and decreasing the "delay between requests".
SpiderBomb is designed for you to
use being "small" to your advantage, and you do have two advantages being
small:
1. You can micro-manage niches and react
quickly. It takes the search engines forever to update and they have so many
"niches" they can't handle them all.
2. You have a human brain and are smarter
than any old search engine ranking program will ever be. You can mix and
match your data using "real person" smarts, not "artificial
intelligence".
Here's an example of YOU vs. Artificial
Intelligence (AI). Let's say you both have a site dedicated to "colors".
But YOU want to do more than just have
a page devoted to each color. So, you create unique blends of pages, relevant
to different themes.
YOU can have a page about "U.S. patriotic"
colors and blend your search results for "red", "white" and "blue" all on
a single page. Artificial Intelligence can't.
Or maybe you're fashion conscious and
know the "in colors for fall" are purple and red. YOU can make a page mixing
results for the colors "purple" and "red" based on real people and trends,
and not simply on words. Artificial Intelligence can't.
And this is the strength of SpiderBomb.
To let you easily build smaller, multiple data files that you can mix
and match in a "human smarts" sort of way.
It isn't meant to be a search engine.
It is meant as a content creation tool to help you target relevant content
and to mix it into more human-friendly blends of topical results.
You'll need SSI to utilize SpiderBomb
to it's fullest potential. SSI is a technique you use to add dynamic results.
We'll show you how to do this...It's just learning how to manipulate a little
"tag" so that webpages can add your search results.
By tapping into the power of SSI, your
pages are html pages, instead of long, dynamic URLS. Most major engines will
index dynamic URLs, but not all of them do. It's worth this little extra
step to insure your pages have the best chance to be included in all search
engines.
But what about the other two elements
of the "Big Boy Business" model, Directory Links (hand picked) and Pay Per
Click Links (for revenue)?
Also included with SpiderBomb is
OdpBomb, which collects links from the famous Open Directory Project.
ODP is an "open source" resource full of high quality links.
How good are ODP links? Good enough for
Google, since Google uses ODP for its own directory. But you don't want to
just copy what Google's doing. You'll want to mix and match OPD results in
smart and unique ways, blending them into pages mixed with your own original
and unique database of SpiderBomb links.
Make money, too! Adding pay per
click links to your site is really fast and easy. There's a number of choices,
all free or low cost.
We'll show you how and where to go to
find all the best pay per click affiliate programs, some paying up to 70%
commision for every click you generate.
These ppc affiliate programs are great
because not only do they add revenue, they also create and supplement your
existing content.
Plus, they offer targeted content/revenue
for a vast amount of niches and topics, for just about any topic you can
imagine.
Pick a topic you're interested in, that
also has some profitability, (we'll show you how) and create an interesting
and useful directory. Mix in Spider and ODP Bombs, and your own site reviews
or awards...
Then use the ppc affiliate programs to
generate revenue.
Remember, this is pretty much the exact
recipe for sucess that six of the top ten most mentioned above use as their
content and business models, except you're adding your human smarts to create
cool and interesting directories that artificial intelligence just can't
match.
Again, Spiderbomb is does not include
a search engine for the public. The search engine is for your use only. You
want to contol the output so you can enhance it and make an easier experience
for your visitors.
Search engines require the user to pysically
type in a search. They have to be thinking about, and type correctly, what
they want to find.
By displaying your SpiderBomb content
as a directory, your site's visitors merely have to look and click. If they
found your site about colors, they may not have been thinking about "red
white and blue", but now that they see it, it may be exactly what they're
looking for...
Don't forget by displaying your content
as a directory, you have much more control over the results and the pages
your visitors will see.
You can now "micro manage" revenue
on a scale that the Big Boys can't match. By using a directory, you can "steer"
visitors to your topics of interest that produce the most revenue.
With a search engine, you're at the mercy
of their search. By being a directory, you totally control what pages
people can see.
There are some great advantages to being
small! The key is to be unique, interesting, informative and PROFITABLE!
SpiderBomb comes complete with
everything you need to get you on the path to creating websites using the
methods of the web's giants, including:
-SpiderBomb: Sohpistated website
spider and page crawler creates free, informative content for your
visitors.
-ODPBomb: Puts the highly respected
ODP/DMOZ resources on your pages.
-Information on free and low cost
pay per click resources that turns your directory traffic into
cash.
-Tips on choosing "starting points"
to make your content relevant and informative.
Order now and start owning your own
mega directories!
Only $117
 |
$137 Installed
|
Your order is secured through
PayPal...
Requirements: Unix/Linux server, Perl,
FTP program and ability to upload and set permissions.
For use on web pages (html) requires
SSI. If you're not sure, just ask your hosting service. Most hosts have this
stuff, but some don't.
Your privacy is guaranteed. I do
not add you to ANY mailing lists. To be notified of news and updates, you
will have to visit the DomBom
Forum. |
