Allow setting of url import bulk size
mikeytown2 - November 4, 2009 - 19:52
| Project: | Boost |
| Version: | 6.x-1.x-dev |
| Component: | Cron Crawler |
| Category: | feature request |
| Priority: | normal |
| Assigned: | Unassigned |
| Status: | closed |
Description
right now its 1,000 for URL alias and 10,000 for url column.
#1
#2
committed
#3
The prune function can only run once, otherwise the counter gets messed up. The quick fix is to only prune once; but with the prune function it would be possible for the crawler to be more robust.
Did a quick test and was able to load 1.2M records in about 10 min, a huge improvement compared to the old way.
#4
committed the fix
#5
Automatically closed -- issue fixed for 2 weeks with no activity.