Hi Guys:
I haven't heard from anyone of you guys in a over a week now. I still haven't result the out of memory problem yet and I tried all the fix you guys recommended. I think the problem lies in how many files Namazu can index. I have no problem indexing a directory that lets say has less than 100,000 files but once the files count goes a little (I haven't narrowed down the exact count) above a 100,000 files I get the out of memory error. The machine I'm using has plenty of memory (562m free). Also, changing the variable contained in "mknmzrc" Namazu uses when indexing doesn't seem to have an effect on the speed of which namazu indexes a directory. Could these problems I'm having be bugs in the program itself?
Thanks,
--leon
-----Original Message-----
From: Makoto Fujiwara [mailto:makoto@xxxxx]
Sent: Sunday, February 04, 2001 9:59 PM
To: Collins, Leon
Cc: developers@xxxxxxxxxx; namazu-devel-ja@xxxxxxxxxx
Subject: Re: Out of Memory
Hi Leon, I have listed following variable,
| $ON_MEMORY_MAX
| ( I believe you have done this already)
| $FILE_SIZE_MAX
| $TEXT_SIZE_MAX
| $WORD_LENG_MAX
But I did not mention the necessity of adding 'package conf;' word for these names.
Have you done that ?
You may say either
----------------------
package conf;
$>
$FILE_SIZE_MAX = 2000000;
$TEXT_SIZE_MAX = 600000;
$WORD_LENG_MAX = 128;
-----------------------
or
------------------------
$conf::>
$conf::FILE_SIZE_MAX = 2000000;
$conf::TEXT_SIZE_MAX = 600000;
$conf::WORD_LENG_MAX = 128;
-----------------------
The value added are defaults, make them smaller.
The other things, it would be helpfull if you add the actual problematic
situation. ( error output ).
mknmz --verbose (other parameter)
mknmz --debug (other parameter)
may also be a clue to resolve the situation.
---
(Makoto Fujiwara)