getting terms ...
done. there is 2700845 terms (10.30 GB assuming 1024 long float vectors)
sorting the terms by frequency ...
the first three term frequencies are 19984689 ('said'), 13665351 ('he'), 10664002 ('from')
building global terms index map ...
reading mapping file ...
done. have 1887314 lemmas associated with 2700845 terms
filtering terms ...
purging terms ...
remapping terms ...
done. lemma miss rate: 0, removed terms: 1483779, shifted terms: 403535, remaining terms: 403535
the first three term frequencies are 23474604 ('SAY'), 15724494 ('HE'), 10665073 ('FROM')

initialization took 00:02:44.01

GPU memory size 790.00 MB, leaving 100.00 MB free. Allocating:
        76.97 MB seed vectors
        52.00 MB dummy vector bank
        20.00 MB chunk and work buffers
        541.03 MB remains for the term vector pool
GPU vector pool allocated to hold up to 138504 vectors (541.03 MB)
warning: gpu space for term vectors may be insufficient
chunk 0: 27284 terms, 0 deallocs (0 final), 27284 allocs, 0 final deallocs (post), 27284 in pool, time 4.40, lag -0.60
processing document 'afp_eng_199405.gz#AFP_ENG_19940528.0122'
chunk 1: 27569 terms, 0 deallocs (0 final), 9762 allocs, 0 final deallocs (post), 37046 in pool, time 4.39, lag -1.21
processing document 'afp_eng_199406.gz#AFP_ENG_19940613.0026'
chunk 2: 26536 terms, 0 deallocs (0 final), 6554 allocs, 0 final deallocs (post), 43600 in pool, time 4.42, lag -1.79
processing document 'afp_eng_199406.gz#AFP_ENG_19940627.0290'
chunk 3: 26231 terms, 0 deallocs (0 final), 5048 allocs, 0 final deallocs (post), 48648 in pool, time 4.42, lag -2.37
processing document 'afp_eng_199407.gz#AFP_ENG_19940712.0029'
chunk 4: 26656 terms, 0 deallocs (0 final), 4714 allocs, 0 final deallocs (post), 53362 in pool, time 4.42, lag -2.95
processing document 'afp_eng_199407.gz#AFP_ENG_19940727.0343'
chunk 5: 28052 terms, 0 deallocs (0 final), 5301 allocs, 0 final deallocs (post), 58663 in pool, time 4.44, lag -3.51
processing document 'afp_eng_199408.gz#AFP_ENG_19940813.0268'
chunk 6: 28970 terms, 0 deallocs (0 final), 5033 allocs, 0 final deallocs (post), 63696 in pool, time 4.69, lag -3.82
processing document 'afp_eng_199408.gz#AFP_ENG_19940829.0278'

.
.
.

chunk 1440: 31095 terms, 981 deallocs (241 final), 981 allocs, 0 final deallocs (post), 138504 in pool, time 3.65, lag -20.00
processing document 'nyt_eng_200205.gz#NYT_ENG_20020503.0420'
chunk 1441: 30554 terms, 960 deallocs (252 final), 960 allocs, 0 final deallocs (post), 138504 in pool, time 3.71, lag -20.00
processing document 'nyt_eng_200205.gz#NYT_ENG_20020509.0103'
chunk 1442: 31231 terms, 959 deallocs (283 final), 959 allocs, 0 final deallocs (post), 138504 in pool, time 3.76, lag -20.00
processing document 'nyt_eng_200205.gz#NYT_ENG_20020514.0152'
chunk 1443: 32074 terms, 973 deallocs (250 final), 973 allocs, 0 final deallocs (post), 138504 in pool, time 3.80, lag -20.00
processing document 'nyt_eng_200205.gz#NYT_ENG_20020519.0002'
chunk 1444: 31702 terms, 1053 deallocs (295 final), 1053 allocs, 0 final deallocs (post), 138504 in pool, time 3.86, lag -20.00
processing document 'nyt_eng_200205.gz#NYT_ENG_20020523.0363'
chunk 1445: 32039 terms, 1106 deallocs (322 final), 1106 allocs, 0 final deallocs (post), 138504 in pool, time 3.76, lag -20.00
processing document 'nyt_eng_200205.gz#NYT_ENG_20020529.0194'
chunk 1446: 32519 terms, 996 deallocs (290 final), 996 allocs, 0 final deallocs (post), 138504 in pool, time 3.70, lag -20.00
processing document 'nyt_eng_200206.gz#NYT_ENG_20020603.0372'
chunk 1447: 30234 terms, 922 deallocs (232 final), 922 allocs, 0 final deallocs (post), 138504 in pool, time 3.74, lag -20.00
processing document 'nyt_eng_200206.gz#NYT_ENG_20020607.0394'
chunk 1448: 31687 terms, 1078 deallocs (309 final), 1078 allocs, 0 final deallocs (post), 138504 in pool, time 3.61, lag -20.00
processing document 'nyt_eng_200206.gz#NYT_ENG_20020612.0431'
chunk 1449: 30811 terms, 979 deallocs (256 final), 979 allocs, 0 final deallocs (post), 138504 in pool, time 3.68, lag -20.00
processing document 'nyt_eng_200206.gz#NYT_ENG_20020617.0399'
chunk 1450: 31565 terms, 1000 deallocs (261 final), 1000 allocs, 0 final deallocs (post), 138504 in pool, time 3.80, lag -20.00
processing document 'nyt_eng_200206.gz#NYT_ENG_20020622.0074'
chunk 1451: 31362 terms, 997 deallocs (242 final), 997 allocs, 0 final deallocs (post), 138504 in pool, time 3.73, lag -20.00
processing document 'nyt_eng_200206.gz#NYT_ENG_20020627.0184'
chunk 1452: 32582 terms, 1093 deallocs (296 final), 1093 allocs, 0 final deallocs (post), 138504 in pool, time 3.86, lag -20.00
processing document 'nyt_eng_200207.gz#NYT_ENG_20020706.0143'
chunk 1453: 33371 terms, 1235 deallocs (350 final), 1235 allocs, 0 final deallocs (post), 138504 in pool, time 3.72, lag -20.00
processing document 'nyt_eng_200207.gz#NYT_ENG_20020718.0004'
chunk 1454: 31975 terms, 1066 deallocs (332 final), 1066 allocs, 0 final deallocs (post), 138504 in pool, time 3.70, lag -20.00
processing document 'nyt_eng_200207.gz#NYT_ENG_20020726.0238'
chunk 1455: 32758 terms, 1058 deallocs (293 final), 1058 allocs, 0 final deallocs (post), 138504 in pool, time 3.69, lag -20.00
processing document 'nyt_eng_200208.gz#NYT_ENG_20020804.0030'
chunk 1456: 31799 terms, 1085 deallocs (303 final), 1085 allocs, 0 final deallocs (post), 138504 in pool, time 3.66, lag -20.00
processing document 'nyt_eng_200208.gz#NYT_ENG_20020809.0243'
chunk 1457: 31856 terms, 1075 deallocs (318 final), 1075 allocs, 0 final deallocs (post), 138504 in pool, time 3.72, lag -20.00
processing document 'nyt_eng_200208.gz#NYT_ENG_20020815.0150'
chunk 1458: 32440 terms, 1046 deallocs (340 final), 1046 allocs, 0 final deallocs (post), 138504 in pool, time 3.80, lag -20.00
processing document 'nyt_eng_200208.gz#NYT_ENG_20020821.0118'
chunk 1459: 31682 terms, 1008 deallocs (317 final), 1008 allocs, 0 final deallocs (post), 138504 in pool, time 3.70, lag -20.00
processing document 'nyt_eng_200208.gz#NYT_ENG_20020826.0270'
chunk 1460: 31861 terms, 1040 deallocs (313 final), 1040 allocs, 0 final deallocs (post), 138504 in pool, time 3.74, lag -20.00
processing document 'nyt_eng_200208.gz#NYT_ENG_20020831.0078'
chunk 1461: 31533 terms, 1079 deallocs (310 final), 1079 allocs, 0 final deallocs (post), 138504 in pool, time 3.58, lag -20.00
processing document 'nyt_eng_200209.gz#NYT_ENG_20020905.0254'
chunk 1462: 31168 terms, 935 deallocs (262 final), 935 allocs, 0 final deallocs (post), 138504 in pool, time 3.61, lag -20.00
processing document 'nyt_eng_200209.gz#NYT_ENG_20020909.0415'
chunk 1463: 31001 terms, 912 deallocs (258 final), 912 allocs, 0 final deallocs (post), 138504 in pool, time 3.74, lag -20.00
processing document 'nyt_eng_200209.gz#NYT_ENG_20020913.0323'
chunk 1464: 31859 terms, 1022 deallocs (363 final), 1022 allocs, 0 final deallocs (post), 138504 in pool, time 3.81, lag -20.00
processing document 'nyt_eng_200209.gz#NYT_ENG_20020919.0257'
chunk 1465: 32280 terms, 965 deallocs (275 final), 965 allocs, 0 final deallocs (post), 138504 in pool, time 3.76, lag -20.00
processing document 'nyt_eng_200209.gz#NYT_ENG_20020924.0355'
chunk 1466: 31311 terms, 961 deallocs (279 final), 961 allocs, 0 final deallocs (post), 138504 in pool, time 3.72, lag -20.00
processing document 'nyt_eng_200209.gz#NYT_ENG_20020929.0181'
chunk 1467: 32281 terms, 1091 deallocs (336 final), 1091 allocs, 0 final deallocs (post), 138504 in pool, time 3.74, lag -20.00
processing document 'nyt_eng_200210.gz#NYT_ENG_20021004.0135'
chunk 1468: 31770 terms, 1094 deallocs (346 final), 1094 allocs, 0 final deallocs (post), 138504 in pool, time 3.78, lag -20.00
processing document 'nyt_eng_200210.gz#NYT_ENG_20021009.0160'
chunk 1469: 31867 terms, 1013 deallocs (315 final), 1013 allocs, 0 final deallocs (post), 138504 in pool, time 3.74, lag -20.00
processing document 'nyt_eng_200210.gz#NYT_ENG_20021014.0257'
chunk 1470: 31436 terms, 982 deallocs (313 final), 982 allocs, 0 final deallocs (post), 138504 in pool, time 3.76, lag -20.00
processing document 'nyt_eng_200210.gz#NYT_ENG_20021018.0342'
chunk 1471: 30779 terms, 923 deallocs (270 final), 923 allocs, 0 final deallocs (post), 138504 in pool, time 3.80, lag -20.00
processing document 'nyt_eng_200210.gz#NYT_ENG_20021024.0096'
chunk 1472: 30866 terms, 854 deallocs (277 final), 854 allocs, 0 final deallocs (post), 138504 in pool, time 3.66, lag -20.00
processing document 'nyt_eng_200210.gz#NYT_ENG_20021028.0397'
chunk 1473: 31793 terms, 1006 deallocs (326 final), 1006 allocs, 0 final deallocs (post), 138504 in pool, time 3.71, lag -20.00
processing document 'nyt_eng_200211.gz#NYT_ENG_20021102.0117'
chunk 1474: 30771 terms, 864 deallocs (308 final), 864 allocs, 0 final deallocs (post), 138504 in pool, time 3.68, lag -20.00
processing document 'nyt_eng_200211.gz#NYT_ENG_20021107.0091'
chunk 1475: 32194 terms, 990 deallocs (330 final), 990 allocs, 0 final deallocs (post), 138504 in pool, time 3.76, lag -20.00
processing document 'nyt_eng_200211.gz#NYT_ENG_20021112.0189'
chunk 1476: 31416 terms, 952 deallocs (342 final), 952 allocs, 0 final deallocs (post), 138504 in pool, time 3.76, lag -20.00
processing document 'nyt_eng_200211.gz#NYT_ENG_20021118.0003'
chunk 1477: 32039 terms, 1019 deallocs (334 final), 1019 allocs, 0 final deallocs (post), 138504 in pool, time 3.79, lag -20.00
processing document 'nyt_eng_200211.gz#NYT_ENG_20021122.0164'
chunk 1478: 31985 terms, 1046 deallocs (341 final), 1046 allocs, 0 final deallocs (post), 138504 in pool, time 3.77, lag -20.00
processing document 'nyt_eng_200211.gz#NYT_ENG_20021127.0278'
chunk 1479: 32016 terms, 1005 deallocs (343 final), 1005 allocs, 0 final deallocs (post), 138504 in pool, time 3.90, lag -20.00
processing document 'nyt_eng_200212.gz#NYT_ENG_20021203.0294'
chunk 1480: 30602 terms, 865 deallocs (293 final), 865 allocs, 0 final deallocs (post), 138504 in pool, time 3.81, lag -20.00
processing document 'nyt_eng_200212.gz#NYT_ENG_20021208.0191'
chunk 1481: 31867 terms, 1045 deallocs (375 final), 1045 allocs, 0 final deallocs (post), 138504 in pool, time 3.84, lag -20.00
processing document 'nyt_eng_200212.gz#NYT_ENG_20021212.0377'
chunk 1482: 30966 terms, 859 deallocs (309 final), 859 allocs, 0 final deallocs (post), 138504 in pool, time 3.77, lag -20.00
processing document 'nyt_eng_200212.gz#NYT_ENG_20021217.0305'
chunk 1483: 30806 terms, 851 deallocs (303 final), 851 allocs, 0 final deallocs (post), 138504 in pool, time 3.88, lag -20.00
processing document 'nyt_eng_200212.gz#NYT_ENG_20021222.0051'
chunk 1484: 33298 terms, 1096 deallocs (442 final), 1096 allocs, 0 final deallocs (post), 138504 in pool, time 4.03, lag -20.00
processing document 'nyt_eng_200212.gz#NYT_ENG_20021228.0074'
chunk 1485: 32129 terms, 990 deallocs (351 final), 990 allocs, 0 final deallocs (post), 138504 in pool, time 3.80, lag -20.00
processing document 'nyt_eng_200301.gz#NYT_ENG_20030103.0095'
chunk 1486: 29595 terms, 824 deallocs (284 final), 824 allocs, 0 final deallocs (post), 138504 in pool, time 3.75, lag -20.00
processing document 'nyt_eng_200301.gz#NYT_ENG_20030108.0150'
chunk 1487: 31461 terms, 917 deallocs (336 final), 917 allocs, 0 final deallocs (post), 138504 in pool, time 3.63, lag -20.00
processing document 'nyt_eng_200301.gz#NYT_ENG_20030113.0204'
chunk 1488: 31887 terms, 1037 deallocs (377 final), 1037 allocs, 0 final deallocs (post), 138504 in pool, time 3.84, lag -20.00
processing document 'nyt_eng_200301.gz#NYT_ENG_20030129.0095'
chunk 1489: 35080 terms, 1854 deallocs (731 final), 1854 allocs, 0 final deallocs (post), 138504 in pool, time 4.05, lag -20.00
processing document 'nyt_eng_200303.gz#NYT_ENG_20030308.0015'
chunk 1490: 35218 terms, 1859 deallocs (608 final), 1859 allocs, 0 final deallocs (post), 138504 in pool, time 4.10, lag -20.00
processing document 'nyt_eng_200304.gz#NYT_ENG_20030411.0092'
chunk 1491: 35951 terms, 1830 deallocs (582 final), 1830 allocs, 0 final deallocs (post), 138504 in pool, time 4.10, lag -20.00
processing document 'nyt_eng_200305.gz#NYT_ENG_20030518.0028'
chunk 1492: 35629 terms, 1827 deallocs (626 final), 1827 allocs, 0 final deallocs (post), 138504 in pool, time 4.16, lag -20.00
processing document 'nyt_eng_200306.gz#NYT_ENG_20030628.0044'
chunk 1493: 35935 terms, 1733 deallocs (581 final), 1733 allocs, 0 final deallocs (post), 138504 in pool, time 4.13, lag -20.00
processing document 'nyt_eng_200308.gz#NYT_ENG_20030811.0041'
chunk 1494: 35451 terms, 1796 deallocs (641 final), 1796 allocs, 0 final deallocs (post), 138504 in pool, time 4.22, lag -20.00
processing document 'nyt_eng_200309.gz#NYT_ENG_20030918.0104'
chunk 1495: 35250 terms, 1602 deallocs (595 final), 1602 allocs, 0 final deallocs (post), 138504 in pool, time 4.15, lag -20.00
processing document 'nyt_eng_200310.gz#NYT_ENG_20031028.0015'
chunk 1496: 35619 terms, 1660 deallocs (580 final), 1660 allocs, 0 final deallocs (post), 138504 in pool, time 4.21, lag -20.00
processing document 'nyt_eng_200312.gz#NYT_ENG_20031207.0026'
chunk 1497: 35395 terms, 1670 deallocs (613 final), 1670 allocs, 0 final deallocs (post), 138504 in pool, time 4.14, lag -20.00
processing document 'nyt_eng_200401.gz#NYT_ENG_20040121.0064'
chunk 1498: 34870 terms, 1579 deallocs (588 final), 1579 allocs, 0 final deallocs (post), 138504 in pool, time 4.13, lag -20.00
processing document 'nyt_eng_200403.gz#NYT_ENG_20040305.0073'
chunk 1499: 35491 terms, 1663 deallocs (644 final), 1663 allocs, 0 final deallocs (post), 138504 in pool, time 4.13, lag -20.00
processing document 'nyt_eng_200404.gz#NYT_ENG_20040422.0039'
chunk 1500: 34727 terms, 1585 deallocs (605 final), 1585 allocs, 0 final deallocs (post), 138504 in pool, time 3.99, lag -20.00
processing document 'nyt_eng_200407.gz#NYT_ENG_20040705.0139'
chunk 1501: 32954 terms, 1298 deallocs (468 final), 1298 allocs, 0 final deallocs (post), 138504 in pool, time 3.93, lag -20.00
processing document 'nyt_eng_200407.gz#NYT_ENG_20040712.0122'
chunk 1502: 32563 terms, 1286 deallocs (499 final), 1286 allocs, 0 final deallocs (post), 138504 in pool, time 3.85, lag -20.00
processing document 'nyt_eng_200407.gz#NYT_ENG_20040718.0108'
chunk 1503: 33351 terms, 1245 deallocs (514 final), 1245 allocs, 0 final deallocs (post), 138504 in pool, time 3.87, lag -20.00
processing document 'nyt_eng_200407.gz#NYT_ENG_20040724.0068'
chunk 1504: 32320 terms, 1222 deallocs (459 final), 1222 allocs, 0 final deallocs (post), 138504 in pool, time 3.83, lag -20.00
processing document 'nyt_eng_200407.gz#NYT_ENG_20040729.0532'
chunk 1505: 32702 terms, 1151 deallocs (463 final), 1151 allocs, 0 final deallocs (post), 138504 in pool, time 3.78, lag -20.00
processing document 'nyt_eng_200408.gz#NYT_ENG_20040804.0324'
chunk 1506: 32789 terms, 1281 deallocs (521 final), 1281 allocs, 0 final deallocs (post), 138504 in pool, time 3.83, lag -20.00
processing document 'nyt_eng_200408.gz#NYT_ENG_20040811.0073'
chunk 1507: 32642 terms, 1322 deallocs (537 final), 1322 allocs, 0 final deallocs (post), 138504 in pool, time 3.84, lag -20.00
processing document 'nyt_eng_200408.gz#NYT_ENG_20040817.0051'
chunk 1508: 32756 terms, 1361 deallocs (542 final), 1361 allocs, 0 final deallocs (post), 138504 in pool, time 3.88, lag -20.00
processing document 'nyt_eng_200408.gz#NYT_ENG_20040823.0071'
chunk 1509: 32829 terms, 1223 deallocs (471 final), 1223 allocs, 0 final deallocs (post), 138504 in pool, time 3.86, lag -20.00
processing document 'nyt_eng_200408.gz#NYT_ENG_20040828.0081'
chunk 1510: 32443 terms, 1083 deallocs (432 final), 1083 allocs, 0 final deallocs (post), 138504 in pool, time 3.77, lag -20.00
processing document 'nyt_eng_200409.gz#NYT_ENG_20040902.0203'
chunk 1511: 31935 terms, 1086 deallocs (452 final), 1086 allocs, 0 final deallocs (post), 138504 in pool, time 3.81, lag -20.00
processing document 'nyt_eng_200409.gz#NYT_ENG_20040908.0304'
chunk 1512: 33044 terms, 1146 deallocs (508 final), 1146 allocs, 0 final deallocs (post), 138504 in pool, time 3.83, lag -20.00
processing document 'nyt_eng_200409.gz#NYT_ENG_20040914.0245'
chunk 1513: 33128 terms, 1146 deallocs (526 final), 1146 allocs, 0 final deallocs (post), 138504 in pool, time 3.70, lag -20.00
processing document 'nyt_eng_200409.gz#NYT_ENG_20040920.0255'
chunk 1514: 32699 terms, 1166 deallocs (532 final), 1166 allocs, 0 final deallocs (post), 138504 in pool, time 3.85, lag -20.00
processing document 'nyt_eng_200409.gz#NYT_ENG_20040926.0110'
chunk 1515: 33351 terms, 1173 deallocs (586 final), 1173 allocs, 0 final deallocs (post), 138504 in pool, time 3.94, lag -20.00
processing document 'nyt_eng_200410.gz#NYT_ENG_20041002.0006'
chunk 1516: 32551 terms, 1087 deallocs (506 final), 1087 allocs, 0 final deallocs (post), 138504 in pool, time 3.80, lag -20.00
processing document 'nyt_eng_200410.gz#NYT_ENG_20041007.0185'
chunk 1517: 32805 terms, 1108 deallocs (510 final), 1108 allocs, 0 final deallocs (post), 138504 in pool, time 3.79, lag -20.00
processing document 'nyt_eng_200410.gz#NYT_ENG_20041013.0195'
chunk 1518: 32662 terms, 1106 deallocs (496 final), 1106 allocs, 0 final deallocs (post), 138504 in pool, time 3.72, lag -20.00
processing document 'nyt_eng_200410.gz#NYT_ENG_20041019.0143'
chunk 1519: 31981 terms, 1101 deallocs (569 final), 1101 allocs, 0 final deallocs (post), 138504 in pool, time 3.84, lag -20.00
processing document 'nyt_eng_200410.gz#NYT_ENG_20041025.0071'
chunk 1520: 32577 terms, 1104 deallocs (542 final), 1104 allocs, 0 final deallocs (post), 138504 in pool, time 3.94, lag -20.00
processing document 'nyt_eng_200410.gz#NYT_ENG_20041030.0036'
chunk 1521: 31190 terms, 1003 deallocs (476 final), 1003 allocs, 0 final deallocs (post), 138504 in pool, time 3.85, lag -20.00
processing document 'nyt_eng_200411.gz#NYT_ENG_20041104.0115'
chunk 1522: 32642 terms, 1149 deallocs (603 final), 1149 allocs, 0 final deallocs (post), 138504 in pool, time 3.97, lag -20.00
processing document 'nyt_eng_200411.gz#NYT_ENG_20041110.0203'
chunk 1523: 33540 terms, 1088 deallocs (532 final), 1088 allocs, 0 final deallocs (post), 138504 in pool, time 3.85, lag -20.00
processing document 'nyt_eng_200411.gz#NYT_ENG_20041116.0235'
chunk 1524: 32845 terms, 1180 deallocs (614 final), 1180 allocs, 0 final deallocs (post), 138504 in pool, time 3.79, lag -20.00
processing document 'nyt_eng_200411.gz#NYT_ENG_20041122.0296'
chunk 1525: 33833 terms, 1225 deallocs (617 final), 1225 allocs, 0 final deallocs (post), 138504 in pool, time 3.85, lag -20.00
processing document 'nyt_eng_200411.gz#NYT_ENG_20041129.0298'
chunk 1526: 33354 terms, 1188 deallocs (618 final), 1188 allocs, 0 final deallocs (post), 138504 in pool, time 3.82, lag -20.00
processing document 'nyt_eng_200412.gz#NYT_ENG_20041205.0186'
chunk 1527: 33862 terms, 1249 deallocs (663 final), 1249 allocs, 0 final deallocs (post), 138504 in pool, time 3.87, lag -20.00
processing document 'nyt_eng_200412.gz#NYT_ENG_20041214.0174'
chunk 1528: 33152 terms, 1126 deallocs (634 final), 1126 allocs, 0 final deallocs (post), 138504 in pool, time 3.82, lag -20.00
processing document 'nyt_eng_200412.gz#NYT_ENG_20041221.0048'
chunk 1529: 33939 terms, 1258 deallocs (669 final), 1258 allocs, 0 final deallocs (post), 138504 in pool, time 3.90, lag -20.00
processing document 'nyt_eng_200412.gz#NYT_ENG_20041228.0172'
chunk 1530: 33749 terms, 3760 deallocs (2145 final), 3760 allocs, 0 final deallocs (post), 138504 in pool, time 4.44, lag -20.00
processing document 'xin_eng_199501.gz#XIN_ENG_19950118.0117'
chunk 1531: 26230 terms, 4547 deallocs (1902 final), 4547 allocs, 0 final deallocs (post), 138504 in pool, time 4.67, lag -20.00
processing document 'xin_eng_199502.gz#XIN_ENG_19950223.0193'
chunk 1532: 26262 terms, 3783 deallocs (737 final), 3783 allocs, 0 final deallocs (post), 138504 in pool, time 4.43, lag -20.00
processing document 'xin_eng_199503.gz#XIN_ENG_19950325.0117'
chunk 1533: 25412 terms, 3682 deallocs (854 final), 3682 allocs, 0 final deallocs (post), 138504 in pool, time 4.40, lag -20.00
processing document 'xin_eng_199504.gz#XIN_ENG_19950428.0002'
chunk 1534: 25912 terms, 3729 deallocs (1164 final), 3729 allocs, 0 final deallocs (post), 138504 in pool, time 4.35, lag -20.00
processing document 'xin_eng_199505.gz#XIN_ENG_19950528.0061'
chunk 1535: 25602 terms, 3314 deallocs (945 final), 3314 allocs, 0 final deallocs (post), 138504 in pool, time 4.32, lag -20.00
processing document 'xin_eng_199506.gz#XIN_ENG_19950628.0004'
chunk 1536: 25873 terms, 3202 deallocs (1047 final), 3202 allocs, 0 final deallocs (post), 138504 in pool, time 4.37, lag -20.00
processing document 'xin_eng_199507.gz#XIN_ENG_19950730.0064'
chunk 1537: 28181 terms, 4057 deallocs (1640 final), 4057 allocs, 0 final deallocs (post), 138504 in pool, time 4.49, lag -20.00
processing document 'xin_eng_199508.gz#XIN_ENG_19950830.0143'
chunk 1538: 25950 terms, 2967 deallocs (727 final), 2967 allocs, 0 final deallocs (post), 138504 in pool, time 4.41, lag -20.00
processing document 'xin_eng_199509.gz#XIN_ENG_19950930.0044'
chunk 1539: 25940 terms, 2912 deallocs (974 final), 2912 allocs, 0 final deallocs (post), 138504 in pool, time 4.31, lag -20.00
processing document 'xin_eng_199510.gz#XIN_ENG_19951031.0193'
chunk 1540: 24996 terms, 2572 deallocs (872 final), 2572 allocs, 0 final deallocs (post), 138504 in pool, time 4.31, lag -20.00
processing document 'xin_eng_199512.gz#XIN_ENG_19951201.0015'
chunk 1541: 24873 terms, 2347 deallocs (867 final), 2347 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_199601.gz#XIN_ENG_19960104.0065'
chunk 1542: 26654 terms, 2772 deallocs (1168 final), 2772 allocs, 0 final deallocs (post), 138504 in pool, time 4.62, lag -20.00
processing document 'xin_eng_199602.gz#XIN_ENG_19960205.0068'
chunk 1543: 26582 terms, 2630 deallocs (1072 final), 2630 allocs, 0 final deallocs (post), 138504 in pool, time 4.34, lag -20.00
processing document 'xin_eng_199603.gz#XIN_ENG_19960308.0020'
chunk 1544: 26831 terms, 2514 deallocs (906 final), 2514 allocs, 0 final deallocs (post), 138504 in pool, time 4.29, lag -20.00
processing document 'xin_eng_199604.gz#XIN_ENG_19960405.0188'
chunk 1545: 25639 terms, 2322 deallocs (885 final), 2322 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_199605.gz#XIN_ENG_19960504.0215'
chunk 1546: 26562 terms, 2289 deallocs (927 final), 2289 allocs, 0 final deallocs (post), 138504 in pool, time 4.29, lag -20.00
processing document 'xin_eng_199606.gz#XIN_ENG_19960601.0086'
chunk 1547: 26645 terms, 2426 deallocs (1099 final), 2426 allocs, 0 final deallocs (post), 138504 in pool, time 4.27, lag -20.00
processing document 'xin_eng_199606.gz#XIN_ENG_19960628.0117'
chunk 1548: 26736 terms, 2289 deallocs (983 final), 2289 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_199607.gz#XIN_ENG_19960725.0133'
chunk 1549: 27421 terms, 2509 deallocs (1184 final), 2509 allocs, 0 final deallocs (post), 138504 in pool, time 4.31, lag -20.00
processing document 'xin_eng_199608.gz#XIN_ENG_19960822.0142'
chunk 1550: 26194 terms, 2123 deallocs (870 final), 2123 allocs, 0 final deallocs (post), 138504 in pool, time 4.21, lag -20.00
processing document 'xin_eng_199609.gz#XIN_ENG_19960919.0015'
chunk 1551: 26110 terms, 2158 deallocs (946 final), 2158 allocs, 0 final deallocs (post), 138504 in pool, time 4.54, lag -20.00
processing document 'xin_eng_199610.gz#XIN_ENG_19961017.0224'
chunk 1552: 25469 terms, 1914 deallocs (825 final), 1914 allocs, 0 final deallocs (post), 138504 in pool, time 4.20, lag -20.00
processing document 'xin_eng_199611.gz#XIN_ENG_19961114.0016'
chunk 1553: 26180 terms, 1973 deallocs (925 final), 1973 allocs, 0 final deallocs (post), 138504 in pool, time 4.29, lag -20.00
processing document 'xin_eng_199612.gz#XIN_ENG_19961212.0211'
chunk 1554: 25545 terms, 1794 deallocs (753 final), 1794 allocs, 0 final deallocs (post), 138504 in pool, time 4.28, lag -20.00
processing document 'xin_eng_199701.gz#XIN_ENG_19970112.0078'
chunk 1555: 27182 terms, 2034 deallocs (1021 final), 2034 allocs, 0 final deallocs (post), 138504 in pool, time 4.33, lag -20.00
processing document 'xin_eng_199702.gz#XIN_ENG_19970212.0012'
chunk 1556: 26383 terms, 1841 deallocs (817 final), 1841 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_199703.gz#XIN_ENG_19970308.0236'
chunk 1557: 25962 terms, 1735 deallocs (776 final), 1735 allocs, 0 final deallocs (post), 138504 in pool, time 4.44, lag -20.00
processing document 'xin_eng_199704.gz#XIN_ENG_19970404.0169'
chunk 1558: 25909 terms, 1826 deallocs (846 final), 1826 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_199705.gz#XIN_ENG_19970502.0089'
chunk 1559: 25773 terms, 1710 deallocs (819 final), 1710 allocs, 0 final deallocs (post), 138504 in pool, time 4.17, lag -20.00
processing document 'xin_eng_199705.gz#XIN_ENG_19970528.0206'
chunk 1560: 25919 terms, 1648 deallocs (745 final), 1648 allocs, 0 final deallocs (post), 138504 in pool, time 4.11, lag -20.00
processing document 'xin_eng_199706.gz#XIN_ENG_19970625.0138'
chunk 1561: 26566 terms, 1787 deallocs (877 final), 1787 allocs, 0 final deallocs (post), 138504 in pool, time 4.17, lag -20.00
processing document 'xin_eng_199707.gz#XIN_ENG_19970724.0166'
chunk 1562: 27232 terms, 1947 deallocs (905 final), 1947 allocs, 0 final deallocs (post), 138504 in pool, time 4.54, lag -20.00
processing document 'xin_eng_199708.gz#XIN_ENG_19970822.0224'
chunk 1563: 27016 terms, 1846 deallocs (922 final), 1846 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_199709.gz#XIN_ENG_19970917.0313'
chunk 1564: 26096 terms, 1645 deallocs (687 final), 1645 allocs, 0 final deallocs (post), 138504 in pool, time 4.17, lag -20.00
processing document 'xin_eng_199710.gz#XIN_ENG_19971015.0039'
chunk 1565: 25678 terms, 1637 deallocs (735 final), 1637 allocs, 0 final deallocs (post), 138504 in pool, time 4.17, lag -20.00
processing document 'xin_eng_199711.gz#XIN_ENG_19971109.0044'
chunk 1566: 24739 terms, 1379 deallocs (550 final), 1379 allocs, 0 final deallocs (post), 138504 in pool, time 4.20, lag -20.00
processing document 'xin_eng_199712.gz#XIN_ENG_19971204.0091'
chunk 1567: 25774 terms, 1521 deallocs (737 final), 1521 allocs, 0 final deallocs (post), 138504 in pool, time 4.12, lag -20.00
processing document 'xin_eng_199712.gz#XIN_ENG_19971231.0047'
chunk 1568: 25930 terms, 1419 deallocs (647 final), 1419 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_199801.gz#XIN_ENG_19980127.0055'
chunk 1569: 26304 terms, 1680 deallocs (830 final), 1680 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_199802.gz#XIN_ENG_19980223.0002'
chunk 1570: 25421 terms, 1329 deallocs (597 final), 1329 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_199803.gz#XIN_ENG_19980319.0064'
chunk 1571: 26256 terms, 1418 deallocs (672 final), 1418 allocs, 0 final deallocs (post), 138504 in pool, time 4.19, lag -20.00
processing document 'xin_eng_199804.gz#XIN_ENG_19980415.0243'
chunk 1572: 26103 terms, 1439 deallocs (688 final), 1439 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_199805.gz#XIN_ENG_19980511.0048'
chunk 1573: 25711 terms, 1461 deallocs (706 final), 1461 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_199806.gz#XIN_ENG_19980604.0093'
chunk 1574: 25237 terms, 1346 deallocs (628 final), 1346 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_199806.gz#XIN_ENG_19980628.0048'
chunk 1575: 25634 terms, 1434 deallocs (740 final), 1434 allocs, 0 final deallocs (post), 138504 in pool, time 4.50, lag -20.00
processing document 'xin_eng_199807.gz#XIN_ENG_19980723.0362'
chunk 1576: 25530 terms, 1471 deallocs (730 final), 1471 allocs, 0 final deallocs (post), 138504 in pool, time 4.17, lag -20.00
processing document 'xin_eng_199808.gz#XIN_ENG_19980817.0132'
chunk 1577: 26090 terms, 1485 deallocs (716 final), 1485 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_199809.gz#XIN_ENG_19980911.0014'
chunk 1578: 25916 terms, 1447 deallocs (724 final), 1447 allocs, 0 final deallocs (post), 138504 in pool, time 4.19, lag -20.00
processing document 'xin_eng_199810.gz#XIN_ENG_19981006.0191'
chunk 1579: 24793 terms, 1272 deallocs (590 final), 1272 allocs, 0 final deallocs (post), 138504 in pool, time 4.44, lag -20.00
processing document 'xin_eng_199810.gz#XIN_ENG_19981031.0016'
chunk 1580: 25519 terms, 1361 deallocs (715 final), 1361 allocs, 0 final deallocs (post), 138504 in pool, time 4.68, lag -20.00
processing document 'xin_eng_199811.gz#XIN_ENG_19981124.0188'
chunk 1581: 26291 terms, 1547 deallocs (771 final), 1547 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_199812.gz#XIN_ENG_19981217.0024'
chunk 1582: 25368 terms, 1339 deallocs (610 final), 1339 allocs, 0 final deallocs (post), 138504 in pool, time 4.27, lag -20.00
processing document 'xin_eng_199901.gz#XIN_ENG_19990113.0293'
chunk 1583: 26361 terms, 1393 deallocs (741 final), 1393 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_199902.gz#XIN_ENG_19990208.0026'
chunk 1584: 25743 terms, 1276 deallocs (646 final), 1276 allocs, 0 final deallocs (post), 138504 in pool, time 4.33, lag -20.00
processing document 'xin_eng_199903.gz#XIN_ENG_19990306.0133'
chunk 1585: 26143 terms, 1363 deallocs (751 final), 1363 allocs, 0 final deallocs (post), 138504 in pool, time 4.21, lag -20.00
processing document 'xin_eng_199903.gz#XIN_ENG_19990330.0006'
chunk 1586: 24642 terms, 1189 deallocs (595 final), 1189 allocs, 0 final deallocs (post), 138504 in pool, time 4.21, lag -20.00
processing document 'xin_eng_199904.gz#XIN_ENG_19990423.0108'
chunk 1587: 24470 terms, 1147 deallocs (591 final), 1147 allocs, 0 final deallocs (post), 138504 in pool, time 4.14, lag -20.00
processing document 'xin_eng_199905.gz#XIN_ENG_19990517.0031'
chunk 1588: 25440 terms, 1298 deallocs (695 final), 1298 allocs, 0 final deallocs (post), 138504 in pool, time 4.32, lag -20.00
processing document 'xin_eng_199906.gz#XIN_ENG_19990610.0183'
chunk 1589: 25124 terms, 1173 deallocs (616 final), 1173 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_199907.gz#XIN_ENG_19990704.0066'
chunk 1590: 26721 terms, 1574 deallocs (883 final), 1574 allocs, 0 final deallocs (post), 138504 in pool, time 4.65, lag -20.00
processing document 'xin_eng_199907.gz#XIN_ENG_19990730.0001'
chunk 1591: 28253 terms, 1741 deallocs (942 final), 1741 allocs, 0 final deallocs (post), 138504 in pool, time 4.38, lag -20.00
processing document 'xin_eng_199908.gz#XIN_ENG_19990824.0230'
chunk 1592: 25968 terms, 1231 deallocs (586 final), 1231 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_199909.gz#XIN_ENG_19990915.0144'
chunk 1593: 26368 terms, 1364 deallocs (744 final), 1364 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_199910.gz#XIN_ENG_19991011.0061'
chunk 1594: 24908 terms, 1073 deallocs (507 final), 1073 allocs, 0 final deallocs (post), 138504 in pool, time 4.56, lag -20.00
processing document 'xin_eng_199911.gz#XIN_ENG_19991103.0268'
chunk 1595: 25725 terms, 1138 deallocs (597 final), 1138 allocs, 0 final deallocs (post), 138504 in pool, time 4.29, lag -20.00
processing document 'xin_eng_199911.gz#XIN_ENG_19991129.0154'
chunk 1596: 24738 terms, 1041 deallocs (548 final), 1041 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_199912.gz#XIN_ENG_19991223.0084'
chunk 1597: 25063 terms, 1138 deallocs (596 final), 1138 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_200001.gz#XIN_ENG_20000120.0096'
chunk 1598: 26897 terms, 1247 deallocs (748 final), 1247 allocs, 0 final deallocs (post), 138504 in pool, time 4.27, lag -20.00
processing document 'xin_eng_200002.gz#XIN_ENG_20000216.0280'
chunk 1599: 26179 terms, 1150 deallocs (606 final), 1150 allocs, 0 final deallocs (post), 138504 in pool, time 4.33, lag -20.00
processing document 'xin_eng_200003.gz#XIN_ENG_20000310.0048'
chunk 1600: 26464 terms, 1168 deallocs (629 final), 1168 allocs, 0 final deallocs (post), 138504 in pool, time 4.32, lag -20.00
processing document 'xin_eng_200004.gz#XIN_ENG_20000403.0281'
chunk 1601: 25746 terms, 1082 deallocs (568 final), 1082 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_200004.gz#XIN_ENG_20000426.0016'
chunk 1602: 25764 terms, 1183 deallocs (686 final), 1183 allocs, 0 final deallocs (post), 138504 in pool, time 4.32, lag -20.00
processing document 'xin_eng_200005.gz#XIN_ENG_20000519.0215'
chunk 1603: 25685 terms, 1187 deallocs (675 final), 1187 allocs, 0 final deallocs (post), 138504 in pool, time 4.37, lag -20.00
processing document 'xin_eng_200006.gz#XIN_ENG_20000612.0522'
chunk 1604: 26085 terms, 1127 deallocs (655 final), 1127 allocs, 0 final deallocs (post), 138504 in pool, time 4.33, lag -20.00
processing document 'xin_eng_200007.gz#XIN_ENG_20000706.0016'
chunk 1605: 26642 terms, 1150 deallocs (678 final), 1150 allocs, 0 final deallocs (post), 138504 in pool, time 4.34, lag -20.00
processing document 'xin_eng_200007.gz#XIN_ENG_20000729.0159'
chunk 1606: 27509 terms, 1342 deallocs (789 final), 1342 allocs, 0 final deallocs (post), 138504 in pool, time 4.35, lag -20.00
processing document 'xin_eng_200008.gz#XIN_ENG_20000824.0119'
chunk 1607: 25604 terms, 1124 deallocs (625 final), 1124 allocs, 0 final deallocs (post), 138504 in pool, time 4.52, lag -20.00
processing document 'xin_eng_200009.gz#XIN_ENG_20000916.0140'
chunk 1608: 26688 terms, 1311 deallocs (783 final), 1311 allocs, 0 final deallocs (post), 138504 in pool, time 4.45, lag -20.00
processing document 'xin_eng_200010.gz#XIN_ENG_20001010.0132'
chunk 1609: 24821 terms, 1124 deallocs (612 final), 1124 allocs, 0 final deallocs (post), 138504 in pool, time 4.18, lag -20.00
processing document 'xin_eng_200011.gz#XIN_ENG_20001102.0159'
chunk 1610: 25291 terms, 1049 deallocs (602 final), 1049 allocs, 0 final deallocs (post), 138504 in pool, time 4.49, lag -20.00
processing document 'xin_eng_200011.gz#XIN_ENG_20001127.0005'
chunk 1611: 25108 terms, 1110 deallocs (671 final), 1110 allocs, 0 final deallocs (post), 138504 in pool, time 4.32, lag -20.00
processing document 'xin_eng_200012.gz#XIN_ENG_20001221.0290'
chunk 1612: 25785 terms, 1070 deallocs (620 final), 1070 allocs, 0 final deallocs (post), 138504 in pool, time 4.31, lag -20.00
processing document 'xin_eng_200101.gz#XIN_ENG_20010119.0008'
chunk 1613: 26678 terms, 1267 deallocs (773 final), 1267 allocs, 0 final deallocs (post), 138504 in pool, time 4.37, lag -20.00
processing document 'xin_eng_200102.gz#XIN_ENG_20010216.0108'
chunk 1614: 26050 terms, 1086 deallocs (624 final), 1086 allocs, 0 final deallocs (post), 138504 in pool, time 4.48, lag -20.00
processing document 'xin_eng_200103.gz#XIN_ENG_20010310.0231'
chunk 1615: 26640 terms, 1132 deallocs (673 final), 1132 allocs, 0 final deallocs (post), 138504 in pool, time 4.44, lag -20.00
processing document 'xin_eng_200104.gz#XIN_ENG_20010403.0095'
chunk 1616: 25811 terms, 1112 deallocs (649 final), 1112 allocs, 0 final deallocs (post), 138504 in pool, time 4.29, lag -20.00
processing document 'xin_eng_200104.gz#XIN_ENG_20010426.0248'
chunk 1617: 26104 terms, 1077 deallocs (672 final), 1077 allocs, 0 final deallocs (post), 138504 in pool, time 4.19, lag -20.00
processing document 'xin_eng_200105.gz#XIN_ENG_20010521.0139'
chunk 1618: 26317 terms, 1192 deallocs (717 final), 1192 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_200106.gz#XIN_ENG_20010614.0036'
chunk 1619: 25524 terms, 1039 deallocs (581 final), 1039 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_200107.gz#XIN_ENG_20010710.0044'
chunk 1620: 25306 terms, 1034 deallocs (641 final), 1034 allocs, 0 final deallocs (post), 138504 in pool, time 4.34, lag -20.00
processing document 'xin_eng_200108.gz#XIN_ENG_20010803.0260'
chunk 1621: 27484 terms, 1429 deallocs (963 final), 1429 allocs, 0 final deallocs (post), 138504 in pool, time 4.63, lag -20.00
processing document 'xin_eng_200108.gz#XIN_ENG_20010826.0229'
chunk 1622: 25844 terms, 1259 deallocs (809 final), 1259 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_200109.gz#XIN_ENG_20010917.0244'
chunk 1623: 24785 terms, 1126 deallocs (684 final), 1126 allocs, 0 final deallocs (post), 138504 in pool, time 4.34, lag -20.00
processing document 'xin_eng_200110.gz#XIN_ENG_20011012.0054'
chunk 1624: 24216 terms, 957 deallocs (541 final), 957 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_200111.gz#XIN_ENG_20011105.0195'
chunk 1625: 26059 terms, 1221 deallocs (773 final), 1221 allocs, 0 final deallocs (post), 138504 in pool, time 4.38, lag -20.00
processing document 'xin_eng_200201.gz#XIN_ENG_20020123.0238'
chunk 1626: 26130 terms, 1230 deallocs (728 final), 1230 allocs, 0 final deallocs (post), 138504 in pool, time 4.34, lag -20.00
processing document 'xin_eng_200202.gz#XIN_ENG_20020218.0105'
chunk 1627: 25246 terms, 1048 deallocs (600 final), 1048 allocs, 0 final deallocs (post), 138504 in pool, time 4.18, lag -20.00
processing document 'xin_eng_200203.gz#XIN_ENG_20020312.0134'
chunk 1628: 25841 terms, 1119 deallocs (730 final), 1119 allocs, 0 final deallocs (post), 138504 in pool, time 4.53, lag -20.00
processing document 'xin_eng_200204.gz#XIN_ENG_20020403.0175'
chunk 1629: 25557 terms, 1085 deallocs (668 final), 1085 allocs, 0 final deallocs (post), 138504 in pool, time 4.13, lag -20.00
processing document 'xin_eng_200204.gz#XIN_ENG_20020425.0154'
chunk 1630: 25566 terms, 1093 deallocs (688 final), 1093 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_200206.gz#XIN_ENG_20020609.0123'
chunk 1631: 25283 terms, 1074 deallocs (677 final), 1074 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_200206.gz#XIN_ENG_20020628.0182'
chunk 1632: 26664 terms, 1316 deallocs (881 final), 1316 allocs, 0 final deallocs (post), 138504 in pool, time 4.31, lag -20.00
processing document 'xin_eng_200207.gz#XIN_ENG_20020722.0210'
chunk 1633: 27456 terms, 1498 deallocs (981 final), 1498 allocs, 0 final deallocs (post), 138504 in pool, time 4.37, lag -20.00
processing document 'xin_eng_200208.gz#XIN_ENG_20020815.0263'
chunk 1634: 27483 terms, 1346 deallocs (846 final), 1346 allocs, 0 final deallocs (post), 138504 in pool, time 4.29, lag -20.00
processing document 'xin_eng_200209.gz#XIN_ENG_20020906.0262'
chunk 1635: 26198 terms, 1156 deallocs (721 final), 1156 allocs, 0 final deallocs (post), 138504 in pool, time 4.22, lag -20.00
processing document 'xin_eng_200209.gz#XIN_ENG_20020928.0075'
chunk 1636: 25824 terms, 1395 deallocs (894 final), 1395 allocs, 0 final deallocs (post), 138504 in pool, time 4.19, lag -20.00
processing document 'xin_eng_200210.gz#XIN_ENG_20021015.0304'
chunk 1637: 25747 terms, 1112 deallocs (699 final), 1112 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_200211.gz#XIN_ENG_20021107.0243'
chunk 1638: 26126 terms, 1173 deallocs (781 final), 1173 allocs, 0 final deallocs (post), 138504 in pool, time 4.18, lag -20.00
processing document 'xin_eng_200211.gz#XIN_ENG_20021129.0027'
chunk 1639: 26388 terms, 1173 deallocs (772 final), 1173 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_200212.gz#XIN_ENG_20021227.0061'
chunk 1640: 25791 terms, 1121 deallocs (752 final), 1121 allocs, 0 final deallocs (post), 138504 in pool, time 4.28, lag -20.00
processing document 'xin_eng_200301.gz#XIN_ENG_20030120.0240'
chunk 1641: 26546 terms, 1173 deallocs (806 final), 1173 allocs, 0 final deallocs (post), 138504 in pool, time 4.30, lag -20.00
processing document 'xin_eng_200302.gz#XIN_ENG_20030212.0125'
chunk 1642: 25385 terms, 965 deallocs (622 final), 965 allocs, 0 final deallocs (post), 138504 in pool, time 4.17, lag -20.00
processing document 'xin_eng_200303.gz#XIN_ENG_20030303.0272'
chunk 1643: 24884 terms, 950 deallocs (593 final), 950 allocs, 0 final deallocs (post), 138504 in pool, time 4.14, lag -20.00
processing document 'xin_eng_200303.gz#XIN_ENG_20030319.0487'
chunk 1644: 24642 terms, 1014 deallocs (676 final), 1014 allocs, 0 final deallocs (post), 138504 in pool, time 4.50, lag -20.00
processing document 'xin_eng_200304.gz#XIN_ENG_20030405.0177'
chunk 1645: 25289 terms, 1044 deallocs (693 final), 1044 allocs, 0 final deallocs (post), 138504 in pool, time 4.44, lag -20.00
processing document 'xin_eng_200304.gz#XIN_ENG_20030426.0117'
chunk 1646: 25412 terms, 1035 deallocs (684 final), 1035 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_200305.gz#XIN_ENG_20030519.0312'
chunk 1647: 26625 terms, 1095 deallocs (775 final), 1095 allocs, 0 final deallocs (post), 138504 in pool, time 4.22, lag -20.00
processing document 'xin_eng_200306.gz#XIN_ENG_20030609.0280'
chunk 1648: 26218 terms, 1131 deallocs (794 final), 1131 allocs, 0 final deallocs (post), 138504 in pool, time 4.25, lag -20.00
processing document 'xin_eng_200307.gz#XIN_ENG_20030701.0051'
chunk 1649: 26281 terms, 1087 deallocs (766 final), 1087 allocs, 0 final deallocs (post), 138504 in pool, time 4.23, lag -20.00
processing document 'xin_eng_200307.gz#XIN_ENG_20030722.0074'
chunk 1650: 26907 terms, 1293 deallocs (951 final), 1293 allocs, 0 final deallocs (post), 138504 in pool, time 4.30, lag -20.00
processing document 'xin_eng_200308.gz#XIN_ENG_20030812.0226'
chunk 1651: 27139 terms, 1209 deallocs (880 final), 1209 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_200309.gz#XIN_ENG_20030908.0250'
chunk 1652: 25780 terms, 1057 deallocs (764 final), 1057 allocs, 0 final deallocs (post), 138504 in pool, time 4.14, lag -20.00
processing document 'xin_eng_200309.gz#XIN_ENG_20030929.0222'
chunk 1653: 26458 terms, 1163 deallocs (875 final), 1163 allocs, 0 final deallocs (post), 138504 in pool, time 4.31, lag -20.00
processing document 'xin_eng_200310.gz#XIN_ENG_20031021.0029'
chunk 1654: 25953 terms, 1064 deallocs (803 final), 1064 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_200311.gz#XIN_ENG_20031111.0090'
chunk 1655: 25768 terms, 1024 deallocs (777 final), 1024 allocs, 0 final deallocs (post), 138504 in pool, time 4.31, lag -20.00
processing document 'xin_eng_200312.gz#XIN_ENG_20031202.0279'
chunk 1656: 26270 terms, 1100 deallocs (826 final), 1100 allocs, 0 final deallocs (post), 138504 in pool, time 4.24, lag -20.00
processing document 'xin_eng_200312.gz#XIN_ENG_20031222.0142'
chunk 1657: 25710 terms, 1039 deallocs (765 final), 1039 allocs, 0 final deallocs (post), 138504 in pool, time 4.17, lag -20.00
processing document 'xin_eng_200401.gz#XIN_ENG_20040115.0214'
chunk 1658: 26858 terms, 1199 deallocs (948 final), 1199 allocs, 0 final deallocs (post), 138504 in pool, time 4.14, lag -20.00
processing document 'xin_eng_200402.gz#XIN_ENG_20040210.0047'
chunk 1659: 26849 terms, 1150 deallocs (903 final), 1150 allocs, 0 final deallocs (post), 138504 in pool, time 4.20, lag -20.00
processing document 'xin_eng_200402.gz#XIN_ENG_20040228.0239'
chunk 1660: 26236 terms, 1024 deallocs (794 final), 1024 allocs, 0 final deallocs (post), 138504 in pool, time 4.09, lag -20.00
processing document 'xin_eng_200403.gz#XIN_ENG_20040316.0401'
chunk 1661: 26388 terms, 1076 deallocs (873 final), 1076 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_200404.gz#XIN_ENG_20040406.0181'
chunk 1662: 25956 terms, 1022 deallocs (833 final), 1022 allocs, 0 final deallocs (post), 138504 in pool, time 4.21, lag -20.00
processing document 'xin_eng_200404.gz#XIN_ENG_20040424.0140'
chunk 1663: 26233 terms, 991 deallocs (844 final), 991 allocs, 0 final deallocs (post), 138504 in pool, time 4.18, lag -20.00
processing document 'xin_eng_200405.gz#XIN_ENG_20040513.0365'
chunk 1664: 26616 terms, 1030 deallocs (873 final), 1030 allocs, 0 final deallocs (post), 138504 in pool, time 4.14, lag -20.00
processing document 'xin_eng_200406.gz#XIN_ENG_20040601.0399'
chunk 1665: 26700 terms, 1019 deallocs (881 final), 1019 allocs, 0 final deallocs (post), 138504 in pool, time 4.26, lag -20.00
processing document 'xin_eng_200406.gz#XIN_ENG_20040622.0278'
chunk 1666: 26456 terms, 971 deallocs (826 final), 971 allocs, 0 final deallocs (post), 138504 in pool, time 4.36, lag -20.00
processing document 'xin_eng_200407.gz#XIN_ENG_20040712.0085'
chunk 1667: 26488 terms, 1118 deallocs (1007 final), 1118 allocs, 0 final deallocs (post), 138504 in pool, time 4.27, lag -20.00
processing document 'xin_eng_200408.gz#XIN_ENG_20040803.0131'
chunk 1668: 27572 terms, 1266 deallocs (1143 final), 1266 allocs, 0 final deallocs (post), 138504 in pool, time 4.50, lag -20.00
processing document 'xin_eng_200408.gz#XIN_ENG_20040821.0270'
chunk 1669: 27237 terms, 1139 deallocs (1039 final), 1139 allocs, 0 final deallocs (post), 138504 in pool, time 4.29, lag -20.00
processing document 'xin_eng_200409.gz#XIN_ENG_20040909.0206'
chunk 1670: 26915 terms, 1073 deallocs (979 final), 1073 allocs, 0 final deallocs (post), 138504 in pool, time 4.15, lag -20.00
processing document 'xin_eng_200410.gz#XIN_ENG_20041001.0094'
chunk 1671: 26428 terms, 991 deallocs (934 final), 991 allocs, 0 final deallocs (post), 138504 in pool, time 4.14, lag -20.00
processing document 'xin_eng_200410.gz#XIN_ENG_20041023.0112'
chunk 1672: 25276 terms, 860 deallocs (819 final), 860 allocs, 0 final deallocs (post), 138504 in pool, time 4.37, lag -20.00
processing document 'xin_eng_200411.gz#XIN_ENG_20041113.0077'
chunk 1673: 26051 terms, 973 deallocs (939 final), 973 allocs, 0 final deallocs (post), 138504 in pool, time 4.57, lag -20.00
processing document 'xin_eng_200412.gz#XIN_ENG_20041205.0186'
chunk 1674: 26430 terms, 934 deallocs (925 final), 934 allocs, 0 final deallocs (post), 138504 in pool, time 4.13, lag -20.00
processing document 'xin_eng_200412.gz#XIN_ENG_20041226.0178'
chunk 1675: 12973 terms, 259 deallocs (259 final), 259 allocs, 138504 final deallocs (post), 0 in pool, time 2.48, lag -20.00
processing document 'xin_eng_200412.gz#XIN_ENG_20041231.0265'


done (it took 01:55:02.41)

peak term usage: 35951; it should be sufficient to use 141.00 MB for the vector pool
cpu waited 00:26:57.41
gpu waited 00:00:00.00
histogram of numbers of removed low-frequency terms per document:
    0 - 1    : 4204413: **************************************************
    1 - 3    : 1133486: **************
    3 - 7    : 294006: ****
    7 - 15   : 51243: *
   15 - 31   :  9585: *
   31 - 63   :  3826: *
   63 - 127  :   556: *
  127 - 255  :    82: *
  255 - 511  :    10: *
  511 - 1023 :     6: *
 1023 - 2047 :     0:
 2047 - 4095 :     0:
 4095 - 8191 :     0:
 8191 - 16383:     0:
16383 - 32767:     0:
32767 - 65535:     0:
  off-scale  :     0:
