Adapting ADtrees for improved performance on large datasets with high-arity features
作者:Robert Van Dam, Irene Langkilde-Geary, Dan Ventura
摘要
The ADtree, a data structure useful for caching sufficient statistics, has been successfully adapted to grow lazily when memory is limited and to update sequentially with an incrementally updated dataset. However, even these modified forms of the ADtree still exhibit inefficiencies in terms of both space usage and query time, particularly on datasets with very high dimensionality and with high-arity features. We propose four modifications to the ADtree, each of which can be used to improve size and query time under specific types of datasets and features. These modifications also provide an increased ability to precisely control how an ADtree is built and to tune its size given external memory or speed requirements.
论文关键词:ADtree, Sufficient statistics, Caching, Large datasets, High-arity feature
论文评审过程:
论文官网地址:https://doi.org/10.1007/s10115-012-0510-0