开发者

Where can I download a free, text-rich dataset?

I want to do a bit of lightweight testing and bench-marking for full-text search, so the dataset should have the qualitie开发者_C百科s:

  • 10,000 - 100,000 records.
  • good dispersion of English words.
  • In CSV or Excel format--i.e. I don't want to access it via API.

Something like books or movies with title and description fields would be perfect. I browsed the UCI Machine Learning Repo, but it was too number-oriented.


You can try
- CKAN
- or search for "Open Data"

Or, see Tim Berners-Lee discussing a quick survey of a few Open Data sets.


If you do not find one, you can create one using the LOREM IPSUM generator

T-SQL equivalent of =rand()

You can also get the full StackOverflow data dump

https://blog.stackoverflow.com/2009/06/stack-overflow-creative-commons-data-dump/


Use the Gutenberg Project. You have access to thousands of English book in plain text. That's what I've used once and was happy with it.

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜