Sampling modes describe how data is loaded into stores.
atoti can handle very large volumes of data while still providing fast answers to queries. However, loading a large amount of data during the modeling phase of the application is rarely a good idea because creating stores, joins, cubes, hierarchies and measures are all operations that take more time when there is more data.
atoti speeds up the sampling process by incorporating an automated sampling mechanism.
By reducing the amount of data, sampling is a way to have immediate feedback for each cell run in a notebook and keep the modeling phase as snappy as possible.
As a rule of thumb:
sampling is always recommended while building a project.
load_all_data()should be called as late as possible.
FULL= SamplingMode(name='full', parameters=)¶
Load all the data in all the stores.
Mode of source loading.
Sampling parameters (number of lines, number of files, …).
Mode to load only the first files of the source.