开发者

Python: How much space does each element of a list take?

I need a very large list, and am trying to figure out how big I can make it so that it still fits in 1-2GB of RAM. I am using the CPython implementation, on 64 bit (x86_64).

Edit: thanks to bua's answer, I have filled in some of the more concrete answers.

What is the space (memory) usage of (in bytes):

  • the list itself
    • sys.getsizeof([]) == 72
  • each list entry (not i开发者_如何学编程ncluding the data)
    • sys.getsizeof([0, 1, 2, 3]) == 104, so 8 bytes overhead per entry.
  • the data if it is an integer
    • sys.getsizeof(2**62) == 24 (but varies according to integer size)
    • sys.getsizeof(2**63) == 40
    • sys.getsizeof(2**128) == 48
    • sys.getsizeof(2**256) == 66
  • the data if it is an object (sizeof(Pyobject) I guess))
    • sys.getsizeof(C()) == 72 (C is an empty user-space object)

If you can share more general data about the observed sizes, that would be great. For example:

  • Are there special cases (I think immutable values might be shared, so maybe a list of bools doesn't take any extra space for the data)?
  • Perhaps small lists take X bytes overhead but large lists take Y bytes overhead?


point to start:

>>> import sys
>>> a=list()
>>> type(a)
<type 'list'>
>>> sys.getsizeof(a)
36
>>> b=1
>>> type(b)
<type 'int'>
>>> sys.getsizeof(b)
12

and from python help:

>>> help(sys.getsizeof)
Help on built-in function getsizeof in module sys:

getsizeof(...)
    getsizeof(object, default) -> int

    Return the size of object in bytes.


If you want lists of numerical values, the standard array module provides optimized arrays (that have an append method).

The non-standard, but commonly used NumPy module gives you fixed-size efficient arrays.

0

上一篇:

下一篇:

精彩评论

暂无评论...
验证码 换一张
取 消

最新问答

问答排行榜