Re: [xwiki-dev] Number of document decrease XWiki performance

Hi Sebastien, I am really sorry for the late reply. Now it remain this problem : it remain that the script used to transfer data from an internal table (I created it) to the XWiki not continu to its end. I have about 200000 entries but the program transfers only 52000 entries without any error message (program is finished but data are not all transfered in the XWiki database). Sébastien Gaïde a écrit : Here it is : <form action="$doc.name" enctype="multipart/form-data" method="get"> Space <input type="text" name="web" value="" size="20" /> <input type="submit" value="Transfert" onclick="form.datafile.value = form.filepath.value"/> </form> <% import com.xpn.xwiki.doc.XWikiDocument import java.io.* import java.sql.* import java.lang.* if (request.getParameter("web") != null)){ // information access String user = "xwiki"; String password = "xwiki"; // connection : the table name is eijiro : eword (text type) and jword (text type) (encoding UTF-8) String url = "jdbc:mysql://localhost/xwiki" + "?user=" + user + "&password=" + password + "&autoReconnect=true" + "&characterEncoding=utf8"; conn = DriverManager.getConnection(url, user, password) Statement stmt = conn.createStatement() // get records SQLstat = "select * from eijiro"; ResultSet st = stmt.executeQuery(SQLstat); recordnbre = 0; while (st.next()){ SourceLangue = "en" SourceValue = st.getString('eword') ExpressionKataPronunciation = "?" TargetLangue = "jp" ExpressionValue = st.getString('jword'); // several translation are possible! EntryContent = "* *Headword* ("+SourceLangue+") \n{code} "+ SourceValue + "{code}\n * *Translation* ("+TargetLangue+") \n{code} " // document creation XW = xwiki.XWiki; XWContext = context.context; XWikiDocument NewEntry = new XWikiDocument(request.getParameter("web"), SourceValue); NewEntry.setContent(EntryContent); XW.saveDocument(NewEntry, XWContext); recordnbre++ } } %> ===============================END No, sorry for that. Here it is : import java.io.*; import java.sql.*; import java.lang.*; /** the table name is eijiro : eword (text type) and jword (text type) */ public class toDBs{ public static void main(String[] args){ // dictionary data text file [eword,jwords[jw1<\t>jw2..]<\n>] String file = "./utf8-gdbm.txt"; File LD_File; FileInputStream Stream_LD=null; BufferedReader Data_LD = null; Reader IR_LD = null; String Line_LD = ""; Connection conn = null; //System.out.println("before"); // database connect data String user = "xwiki"; String password = "xwiki"; String url = "jdbc:mysql://localhost/xwiki" + "?user=" + user + "&password=" + password + "&autoReconnect=true" + "&characterEncoding=utf8"; try{ LD_File = new File(file); Stream_LD = new FileInputStream(LD_File); IR_LD = new InputStreamReader(Stream_LD,"UTF-8"); Data_LD = new BufferedReader(IR_LD); Class.forName( "com.mysql.jdbc.Driver" ).newInstance(); conn = DriverManager.getConnection(url, user, password); Statement stmt = conn.createStatement(); String line; String eword; String jword; int cnt = 0; // read line System.out.println("before"); float compter = 0; while( ( line = Data_LD.readLine() ) != null) { // br.readLine() // split string is "," compter++; String[] split = line.split( "," ); // "'" convert to "\'" eword = split[0].replaceAll( "'", "\\\\'" ); jword = split[1].replaceAll( "'", "\\\\'" ); // insert to database String MySQLStat = "insert into eijiro values ( '"+eword+"', '"+jword+"','')"; stmt.executeUpdate( MySQLStat); //stmt.executeUpdate( "insert into TriaxSEijiro values ( '" + compter + "', '" +eword+ "', '" + "en" + "','"+ "neant" + "')" ); //stmt.executeUpdate( "insert into TriaxTEijiro values ( '" + compter + "', '" +compter+ "', '" +"1"+ "', '" +jword+ "','"+"jp"+ "' )" ); } // close Data_LD.close(); stmt.close(); conn.close(); } catch (Exception e){ System.out.println(e); if (e instanceof SQLException){ System.out.println("SQLException: " + e.getMessage()); System.out.println("SQLState: " + ((SQLException)e).getSQLState()); System.out.println("Code: " + ((SQLException)e).getErrorCode()); } } finally{ if (conn != null){ try{ conn.close(); }catch (Exception e){ System.out.println("SQLException: " + e.getMessage()); System.out.println("SQLState: " + ((SQLException)e).getSQLState()); System.out.println("Code: " + ((SQLException)e).getErrorCode()); } } } } } ==============================================END This kind of functionalities interest me, I would like that you lead me how to do that? Is that transfer done by an external program or an integrated script in the core of XWiki? In fact, I tried to transfer 300000 entries in the doc table of XWiki database (I fill all data and also created and unique ID of each document). The only problem was with the magic ID of document that XWiki API create:-)! When I take randomly any document that I have put in the doc table and changing its ID by an existing ID (of another document) that have been generated automaticaly by XWiki (e.g created in the environment), so the considered document can be detected and managed by XWiki, else no document of 300000 that exists in the doc table have been detected by XWiki. I read the code source but I did not understand the method that have been followed for the generation of the ID? Please let me know these indexes... Many thanks in advance. Cheers -------------------------- Youcef Bey