Double^W Quadruple speed parsing of binary MS Office files

[Jos van den Oever]

On Monday, June 13, 2011 19:02:09 PM Jos van den Oever wrote:
> When run on a set of 600 ppt files from a.o. kofficetests, this is the
> output from valgrind:
> simpletest: (normal run time: 5.7 seconds)
> ==28930==   total heap usage: 2,457,961 allocs, 2,457,954 frees,
> 218,241,950 bytes allocated
> apitest: (normal run time: 2.9 seconds)
> ==28852==   total heap usage: 254,832 allocs, 254,825 frees, 52,421,077
> bytes allocated
The speed for apitest is now down to 1.3 seconds, making the speedup 4.3x.
The other numbers stay the same.

> That's almost 10x fewer memory allocations and 4.2x lower memory usage.
> All the memory allocations for apitest are from POLE, since api.h does not
> do any memory allocations while parsing. This is partially what makes it
> fast: all memory is either in the continuous parsed stream or on the
> stack.