Can PHP Zend Lucene handle indexes of over 1 million documents?

Is anyone aware of have the experience of using PHP Zend Lucene ( search engine ) with repositories of more than 1 million.

Thanks f开发者_如何学运维or your feedback

Indexing with PHP Lucene with Java

I think if you want good performance, you may want to consider using sphinx over PHP Zend Lucene, unless your project requires Lucene indexes.

When I was looking at this a year or so ago, I found some benchmarks comparing PHP Lucence vs sphinx. Sphinx won by a long shot.

A lot depends on the architecture of your application, but I wouldn't worry about the number of items. Lucene is known of being slow (building indexes) on very large projects, but has a nice upgrade to Solr.

Solr is the popular, blazing fast open source enterprise search platform from the Apache Lucene project. Its major features include powerful full-text search, hit highlighting, faceted search, dynamic clustering, database integration, rich document (e.g., Word, PDF) handling, and geospatial search. Solr is highly scalable, providing distributed search and index replication, and it powers the search and navigation features of many of the world's largest internet sites.

I have no direct experience, but I have seen complaints that Zend Lucene is both slow and memory intensive, so much so that it actually fails with "large" indices and "small" memory constraints. Of course, what constitutes a large index and a small memory constraint is essence of the issue.

The following two threads contain some specifics that seem to suggest that 1 million documents is likely to be trouble:

• Fatal Error Search Lucene Memory Size
• Recommendation: Don’t use Zend PHP Lucene!

Other developers whom I respect speak very well of Sphinx for both speed and memory.

Personally, I am considering trying out Zend Lucene on a small project - probably no more than 1,000 documents in the index because I am restricted to shared hosting (as far as I understand, Sphinx requires an external daemon). But I'm still crossing my fingers.