Web Hosting Talk







View Full Version : New Search Engine


JayC
03-18-2002, 03:51 AM
For awhile this will be more fun than useful, because it's still in early beta... but it is interesting if you're interested in search engines: a rare chance to see one develop.

And for those frustrated by how hard it is to get listed in some SEs, how about this: an "add URL" page that results in an almost immediate spidering of your requested page!

www.gigablast.com

The beta's been up just a couple of days, and actually early today there were over 2 million pages indexed but because of a system glitch they had to start over. Right now it's at 275,000 pages and building.

So submit for fun (and go watch your logs for fun, a fast-acting search engine), but as today's experience shows remember that your listing might disappear soon anyway so don't take it too seriously yet. You just have to submit your index page; the rest will get spidered.

cabweb
03-18-2002, 04:00 AM
There search engine seems slow.
I prefer Google.
It could be low due to the large reindexing they are performing.
Thanks for the new link.
CAB

JayC
03-18-2002, 04:23 AM
Originally posted by cabweb
There search engine seems slow.As I said, it's in early beta. Actually, pre-beta. They're still working out the algorithms, the SERPs have been redone just today, also a couple of bugs just fixed. Link analysis isn't yet active. It by no means should yet be looked at as a usable search engine.

And right now it's only running on a few machines, so it can't really be compared to Google, which is distributed over thousands.

Hopefully it'll become something good, but right now I'd just look at it as a toy... and I want to help out by submitting stuff to put it through it's paces!

akashik
03-19-2002, 01:47 AM
Until I checked that site out, it just occurred to me that you don't see a lot of this kind of experimental development anymore (at least I don't). Especially when it comes to search engines and that whole infrastructure of the net thing. Thanks for the link. I notice our site has already been indexed. :)

Greg Moore

mahinder
03-19-2002, 08:27 AM
i submitted my all urls lets see what is going to happen. !

:)

JayC
03-19-2002, 12:54 PM
Back down to 600,000 urls indexed right now. Once again last night the database was cleared out and started over.

By the way, anyone else notice that the number of replies shown for this thread is incorrect? This is reply 5, but the thread list will say 4...

Justice
03-19-2002, 03:55 PM
not to be an *******, but what exactly makes this search engine different or special?

JayC
03-19-2002, 04:12 PM
Originally posted by Justice
what exactly makes this search engine different or special? It's brand new, so watching it develop is interesting to those of us who are interested in search engines.

It accepts free submissions and has no paid inclusion program, which will make it unique among search engines once it's operational -- at least for as long as that remains true.

It responds to spidering requests almost instantaneously and adds the spidered pages to its index immediately, which is both unique among current search engines, fun to watch, and a relief for those frustrated by having to wait months without ever really knowing whether a site will be indexed.

And the "last 5 searches" window doubles as a chatroom! :)

Anyone who was around and paying attention during the early development of infoseek or google probably found that as interesting. But these days we're seeing fewer search engines, not more... so this is unique.

It may be a sign of things to come, though. With today's cheap hardware and search engine applications that can be purchased and run practically as is, the obstacles have never been smaller.

BC
03-19-2002, 05:49 PM
Originally posted by JayC
Back down to 600,000 urls indexed right now. Once again last night the database was cleared out and started over.

By the way, anyone else notice that the number of replies shown for this thread is incorrect? This is reply 5, but the thread list will say 4...

OT/

We'll get the thread tables re-indexed sometime soon.......

/OT/

akashik
03-19-2002, 07:54 PM
Originally posted by JayC
And the "last 5 searches" window doubles as a chatroom! :)

I was looking at that nifty little feature and reloading to see it change - I never thought of that chatroom idea though :D

Greg Moore

CChard
03-19-2002, 11:13 PM
They can build a serch engine, but they can't make a nice image.... :stickout

Good luck.

Neo3Net
03-20-2002, 12:02 AM
I hate both SPAMS first of all WHO THE HELL WOULD EAT THAT CRAP (I am italian and have my mother who cooks amazing meals so sorry if I am offending anyone) :D

Second.....This isn't spam it just tells us about a new search engine......I like it....The engine is very clean and doesn't have garbage like Yahoo and AOL and stuff.

:spam:

TradeViceroy
03-20-2002, 12:13 AM
I like this project!

Already looking good. May I suggest you up the font size one on the menu?

If you need any help...let me know. =)

sam.moses
03-20-2002, 01:44 AM
Nice,
I'm working on a project very much like this one.
I'm experimenting with the idea of a search engine with live data.