The sparse types: Dynamic and Static

Sparse structures can be of two types Dynamic or Static.

 

The sparse size and the sparse type affect the loading process only. Consider a Data Reader protocol loading several InfoCubes each having multiple versions and different sparse structures. When the size of the sparse structures becomes larger and larger then the DataReader might run out of memory and fail to import any more data. A sparse structure can be considered large when its size exceeds 30 million combinations but this limit may vary depending on the hardware. When the memory limit is reached, reduce the number of InfoCubes included in the protocol or remove some secondary versions from the InfoCubes. If this is not sufficient and there is a sparse version that exceeds 20 or 30 million combinations, then change the sparse type to Static. The number of versions of an InfoCube can affect the size limit: if an InfoCube has a single sparse structure, it can reach a much higher size than if it has more than one version.

 

The maximum number of sparse combinations that a sparse structure can reach is around 30 millions for a Dynamic structure and 150 millions or more for Static structures. However a practical limitation, fundamentally determined by RAM constraints, can occur before those limits. Note that most large databases, with entities having several thousand members, have sparse structures that rarely exceed 1 or 2 million combinations.

 

When the size of the sparse structure reaches its size limit the DataReader is unable to add new combinations and starts rejecting records and an error message is logged on the database log file. When this error appears, then you can consider changing the sparse type; in all other cases do not change the default sparse type.

 

Dynamic. This is the default type, suitable in most cases for sparse structures which have up to 10 to 30 million combinations or more. This limit can change depending on the hardware and software environment and on the Board database.

 

Static. This type of sparse is suitable for sparse structures which have up to 40 to 100 million combinations (this limit can change depending on the hardware and software environment and on the Board database). To set the sparse type, open the Entities window then go to the Sparsity tab. select ”Static” from the Type / Location drop-down list Then type the size (in millions) of the sparse structure, round the value up to the nearest 5 million, in the Max Item Nr column. For example, if the actual sparse size is of 23 million, type 25.