Reclassify is much slower in 1.1.0 than it is in 0.22.5
|Reported by:||Brian Smith||Owned by:||Brian Smith|
Description (last modified by )
The Slower reclassifications topic in the
HELP OPEN DISCUSSION forum complains that reclassify operations which used to take around 6 seconds with 0.22.5 now take around 47 seconds after upgrading to 1.1.0.
The SQLite database involved is large (0.22.5 size was 102,807 Kb, after the upgrade to 1.1.0 the size is 50,735 Kb)
I've confirmed this behaviour using some test data:
0.22.5 with 150 MB database performs reclassifications in around 9 seconds per message (tested using message sizes up to 99.9 KB)
After upgrading to 1.1.0 RC5 the reclassify times were around 19 seconds (similar size messages used)
After upgrading to current SVN (getting ready for 1.1.1 RC2) the time increased to over 26 seconds or even over 30 seconds. Changing from "delete" to "memory" for the SQLite journal mode reduced the times by only a few seconds (e.g. 24 instead of 26 seconds).
I have just noticed that the ADVANCED page in 1.1.1's UI still shows bayes_sqlite_tweaks even though the Option Reference page no longer lists this parameter. If I shutdown POPFile and delete this line from popfile.cfg it gets reinstated the next time I start POPFile. I thought these tweaks were all to do with tweaking SQLite 2.x - are any of them still relevant now that we are using SQLite 3.x?
[Edited to correct the name of the forum]