How to build a in-site search engine with php?

I want to build a in-site search engine with php. Users must login to see the information. So I can't use the google or yahoo search engine code.

I want to make the engine searching for the text and pages, and not the tables in mysql database right now.

Has anyone ever done this? Could you gi开发者_Go百科ve me some pointers to help me get started?

you'll need a spider that harvests pages from your site (in a cron job, for example), strips html and saves them in a database

You might want to have a look at Sphinx http://sphinxsearch.com/ it is a search engine that can easily be access from php scripts.

You can cheat a little bit the way the much-hated Experts-Exchange web site does. They are for-profit programmer's Q&A site much like StackOverflow. In order to see answers you have to pay, but sometimes the answers come up in Google search results. It is rather clear that E-E present different page for web crawlers and different for humans. You could use the same trick, then add Google Custom Search to your site. Users who are logged in would then see the results, otherwise they'd be bounced to login screen.

Do you have control over your server? Then i would recommend that you install Solr/Lucene for index and SolPHP for interacting with PHP. That way you can have facets and other nice full text search features.

I would not spider the actual pages, instead i would spider pages without navigation and other things that is not content related.

SOLR requiers Java on the server.

I have used sphider finally which is a free tool, and it works well with php.

Thanks all.

If the content and the titles of your pages are already managed by a database, you will just need to write your search engine in php. There are plenty of solutions to query your database, for example:

http://www.webreference.com/programming/php/search/

If the content is just contained in html files and not in the db, you might want to write a spider.

You may be interested in caching the results to improve the performances, too.

I would say that everything depends on the size and the complexity of your website/web application.