Open Source key/value capable of high [storage] capacity [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.

---

We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.

Closed 7 years ago.

Improve this question

I'm looking for a key/value store meeting the following requirements:

1. Open Source
2. C API (C++ okay too)
3. ACID
4. Some level of crash recovery
5. High [storage] capacity per file
6. Both key and value are arbitrary binary data
7. Embedded (like DBM, SQLite, et al.)

GDBM looks particularly attractive. Per the fact that the datum struct uses int dsize; clearly key and value sizes are limited to 2GB, which is fine. However, my problem with GDBM is that I can't find any documentation on the limit to the database file sizes. For example, Berkeley DB provides database files up to 256TB. If this is la开发者_高级运维rge enough, then GDBM would be perfect.

Does anyone know the GDBM file size cap? Failing that (or if it's too small) what other suggestions can you make? Does such a beast exist?

---

If you're using GDBM on a 32-bit (i386) system, the maximum database size is 2GB. If you're using it on a 64-bit system and you compile your app 64-bit, then the maximum database size should be limited by your filesystem.