[xwiki-dev] Number of document decrease XWiki performance

[Sébastien Gaïde]

Youcef BEY a écrit :
> Hi all,

Hi Youcef,

> - using this program to create automatically a document work well for 
> few documents:
> 
>   XW = xwiki.XWiki;
>   XWContext = context.context;
>   XWikiDocument NewEntry = new 
> XWikiDocument(request.getParameter("web"), SourceValue);
>   NewEntry.setContent(EntryContent);
>  XW.saveDocument(NewEntry, XWContext);

could you please send us the real script you are using ? (I mean as much 
'real' as possible).

> LOOP, the xwiki display error "out of memory!"

have you got a stack trace ?

> But now, taking the same program and run it in the shell (javac, java) 
> to transfert these 10000 entries to TABLE in the XWiki database, it's 
> done in less 1 minute?

could you please send us the source of this ?

I'm generating wikis automatically using XWiki apis, the biggest wiki 
created hold 165 000 pages (each page containing between one to 5 
objects). the only problem I got was about the archive handling that I 
had to disable (which is not a problem since the pages are generated and 
not edited), this was with an old XWiki version (svn 1226), since then 
the archive system relies on another framework, so this may be not an 
issue anymore (we are still using the same XWiki version).

I'm using only 4 indexes (I will post a reply tomorrow with the indexed 
columns, I don't remember exactly and I can't access this information 
right now). These indexes have greatly improved response time (at first 
the biggest page (2,5 MB!) took 25 minutes to render ;-) after indexes 
creation, and some other tweaking, it took only a few seconds).

indexes will improve response time, but it will not protect you from an 
out of memory exception.

if you can send the scripts you are using to the list, I will be able to 
run them on our wikis to see the result ...

Seb.