Hello all, here would be the query: select xwd_fullname from xwikidoc where xwd_content like concat("%",char(1),"%"); (I've seen many indicate that || would be the concatenation operator, but it seems like it is not the case in like operands) Based on that, Peter, you should be able to filter things out. Now, to the XML 1.1 export. In principle this is not a big deal, but we should be clear on what it implies for parser libraries. The move to XML 1.1 has been more than frigid. Note also, that this support is pretty limited (only &x references). I'd prefer if we find a way to get rid of such gremlins. To my experience they are only the spurious result of copy and paste. One particular family of documents where these gremlins happen are PDF documents generated by TeX. The venerable typesetting had a tradition of funky encoding, since it also had its own fonts and all that was far before the move even to 16 bits. I believe that the editor or the save process should remove anything below ASCII 32 except CR, LF, and TAB. Can the migration process be interactive to ask about them? Should we "just" zap them or replace them by a character? Does someone find a reason to keep them? Paul PS: the "gremlins" name here comes from BBEdit/TextWrangler who had a function "Zap Gremlins" since a decade at least.
Thomas Mortagne <mailto:[email protected]> 22 February 2016 at 14:10 What I can say from the error is that the character is in a document content at least (not a title, or an object) but it does not help much reduce the scope.
You could try to find it with a SQL request I guess, need to find how to search this specific character in a SQL request.
On Mon, Feb 22, 2016 at 2:01 PM, Thomas Mortagne
Thomas Mortagne <mailto:[email protected]> 22 February 2016 at 14:01 On Mon, Feb 22, 2016 at 12:46 PM, Peter John Acklam <[email protected]> wrote:
Avoiding this problem in the future would be nice, but I already have this character in my wiki, and I need to get rid of it. I don't know how it got there, but more importantly, I need to find it, so I can remove it. With no XAR export, we can't do our planned transision from an Oracle to a PostgreSQL database.
As for the discussion on markmail.org – I have registered there, but I can't find anything on the webpage that allows me to take part in the discussion.
Yes you can't write from markmail, was probably not the best link to give :)
I think you can sent mails from nabble (through http://dev.xwiki.org/xwiki/bin/view/Community/Forum or http://xwiki.475771.n2.nabble.com/Should-we-move-to-XML-1-1-in-XAR-td7598066...).
Cheers, Peter
2016-02-22 12:15 GMT+01:00 Thomas Mortagne <[email protected]>:
Starting a discussion on this subject on http://markmail.org/message/32vnzxchphr26phh.
If you have more input on what is this character doing here please share there.
On Mon, Feb 22, 2016 at 11:55 AM, Thomas Mortagne <[email protected]> wrote:
Actually I do know why it's writting XML 1.0, that's because we tell it to... Did not know XML 1.0 was not supporting anything, I'm surprise we get this kind of report only know.
Anyway thanks for the report, will take care of this.
On Mon, Feb 22, 2016 at 11:31 AM, Thomas Mortagne <[email protected]> wrote:
What I understand from the error message is that Woodstox think it's writing XML 1.0 and looks like it's not possible to put anything you want in XML 1.0 but not sure why exactly. You happen to have a document containing some weird character (0x1) which is probably a mistake but still we should be able to export anything (especially when this anything can be stored in a String and in the database).
In the meantime what you can try is to set the old exporter in xwiki.cfg (look at xwiki.action.export.xar.usewikistream property). Would be great if you could crate an issue on http://jira.xwiki.org with all the information you can gather about this bug.
On Mon, Feb 22, 2016 at 10:18 AM, Peter John Acklam <[email protected]> wrote:
I can no longer make a XAR export of our wiki. The essential error message in catalina.out seems to be
"Invalid white space character (0x1) in text to output (in xml 1.1, could output as a character entity)"
Alas, there is no information about which wiki page contains this invalid character. I can, of course, export parts of the wiki and repeat the process until I find the offending page, but I suspect there has got to be a more efficient way.
The full, relevant section of catalina.out on our test server is included below.
Thanks in advance for any tips!
Cheers, Peter John Acklam
2016-02-19 09:36:17,163 [
http://wiki-test/xwiki/bin/export/XWiki/XWikiPreferences?editor=globaladmin&... ]
WARN c.x.x.w.XWikiAction - Uncaught exception: Error number 11015 in 11: Exception while exporting com.xpn.xwiki.XWikiException: Error number 11015 in 11: Exception while exporting at com.xpn.xwiki.web.ExportAction.render(ExportAction.java:84) ~[xwiki-platform-legacy-oldcore-7.4.1.jar:na] at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:417) [xwiki-platform-legacy-oldcore-7.4.1.jar:na] at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:184) [xwiki-platform-legacy-oldcore-7.4.1.jar:na] at
org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:425)
[struts-core-1.3.10.jar:1.3.10] at
org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:228)
[struts-core-1.3.10.jar:1.3.10] at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913) [struts-core-1.3.10.jar:1.3.10] at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:462) [struts-core-1.3.10.jar:1.3.10] at javax.servlet.http.HttpServlet.service(HttpServlet.java:648) [servlet-api.jar:na] at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) [servlet-api.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:291)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at com.xpn.xwiki.web.ActionFilter.doFilter(ActionFilter.java:115) [xwiki-platform-legacy-oldcore-7.4.1.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at
org.xwiki.wysiwyg.server.filter.ConversionFilter.doFilter(ConversionFilter.java:127)
[xwiki-platform-wysiwyg-server-7.4.1.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) [tomcat-websocket.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at
org.xwiki.container.servlet.filters.internal.SetHTTPHeaderFilter.doFilter(SetHTTPHeaderFilter.java:63)
[xwiki-platform-container-servlet-7.4.1.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at
com.xpn.xwiki.plugin.webdav.XWikiDavFilter.doFilter(XWikiDavFilter.java:66)
[xwiki-platform-webdav-server-7.4.1.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at
org.xwiki.container.servlet.filters.internal.SavedRequestRestorerFilter.doFilter(SavedRequestRestorerFilter.java:208)
[xwiki-platform-container-servlet-7.4.1.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at
org.xwiki.container.servlet.filters.internal.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:111)
[xwiki-platform-container-servlet-7.4.1.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at
org.xwiki.resource.servlet.RoutingFilter.doFilter(RoutingFilter.java:137)
[xwiki-platform-resource-servlet-7.4.1.jar:na] at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
[catalina.jar:8.0.30] at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
[catalina.jar:8.0.30] at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:212)
[catalina.jar:8.0.30] at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:106)
[catalina.jar:8.0.30] at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502)
[catalina.jar:8.0.30] at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:141)
[catalina.jar:8.0.30] at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79)
[catalina.jar:8.0.30] at
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:616)
[catalina.jar:8.0.30] at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:88)
[catalina.jar:8.0.30] at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:521)
[catalina.jar:8.0.30] at
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1096)
[tomcat-coyote.jar:8.0.30] at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:674)
[tomcat-coyote.jar:8.0.30] at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1500)
[tomcat-coyote.jar:8.0.30] at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1456)
[tomcat-coyote.jar:8.0.30] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[na:1.8.0_66] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_66] at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
[tomcat-util.jar:8.0.30] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66] Caused by: org.xwiki.filter.FilterException: Failed to write element at
org.xwiki.filter.xml.internal.output.FilterStreamXMLStreamWriter.writeCharacters(FilterStreamXMLStreamWriter.java:158)
~[xwiki-commons-filter-xml-7.4.1.jar:na] at
org.xwiki.filter.xml.internal.output.FilterStreamXMLStreamWriter.writeElement(FilterStreamXMLStreamWriter.java:145)
~[xwiki-commons-filter-xml-7.4.1.jar:na] at
org.xwiki.filter.xar.internal.output.XAROutputFilterStream.beginWikiDocumentRevision(XAROutputFilterStream.java:349)
~[xwiki-platform-filter-stream-xar-7.4.1.jar:na] at sun.reflect.GeneratedMethodAccessor601.invoke(Unknown Source) ~[na:na] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[na:1.8.0_66] at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_66] at org.xwiki.filter.internal.FilterProxy.invoke(FilterProxy.java:90) ~[xwiki-commons-filter-api-7.4.1.jar:na] at org.xwiki.filter.internal.FilterProxy.invoke(FilterProxy.java:63) ~[xwiki-commons-filter-api-7.4.1.jar:na] at com.sun.proxy.$Proxy88.beginWikiDocumentRevision(Unknown Source) ~[na:na] at
org.xwiki.filter.instance.internal.input.XWikiDocumentLocaleEventGenerator.writeRevision(XWikiDocumentLocaleEventGenerator.java:167)
~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.XWikiDocumentLocaleEventGenerator.write(XWikiDocumentLocaleEventGenerator.java:116)
~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.XWikiDocumentLocaleEventGenerator.write(XWikiDocumentLocaleEventGenerator.java:55)
~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.AbstractBeanEntityEventGenerator.write(AbstractBeanEntityEventGenerator.java:114)
~[xwiki-platform-filter-instance-api-7.4.1.jar:na] at
org.xwiki.filter.instance.input.AbstractEntityEventGenerator.write(AbstractEntityEventGenerator.java:77)
~[xwiki-platform-filter-instance-api-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.DocumentInstanceInputEventGenerator.beginWikiDocument(DocumentInstanceInputEventGenerator.java:107)
~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.writeDocument(InstanceInputFilterStream.java:229)
~[xwiki-platform-filter-instance-api-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.writeSpace(InstanceInputFilterStream.java:195)
~[xwiki-platform-filter-instance-api-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.writeWiki(InstanceInputFilterStream.java:161)
~[xwiki-platform-filter-instance-api-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.read(InstanceInputFilterStream.java:130)
~[xwiki-platform-filter-instance-api-7.4.1.jar:na] at
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.read(InstanceInputFilterStream.java:54)
~[xwiki-platform-filter-instance-api-7.4.1.jar:na] at
org.xwiki.filter.input.AbstractBeanInputFilterStream.read(AbstractBeanInputFilterStream.java:80)
~[xwiki-commons-filter-api-7.4.1.jar:na] at com.xpn.xwiki.web.ExportAction.exportXAR(ExportAction.java:337) ~[xwiki-platform-legacy-oldcore-7.4.1.jar:na] at com.xpn.xwiki.web.ExportAction.render(ExportAction.java:77) ~[xwiki-platform-legacy-oldcore-7.4.1.jar:na] ... 50 common frames omitted Caused by: com.ctc.wstx.exc.WstxIOException: Invalid white space character (0x1) in text to output (in xml 1.1, could output as a character entity) at
com.ctc.wstx.sw.BaseStreamWriter.writeCharacters(BaseStreamWriter.java:458)
~[woodstox-core-asl-4.4.1.jar:4.4.1] at
javanet.staxutils.IndentingXMLStreamWriter.writeCharacters(IndentingXMLStreamWriter.java:209)
~[stax-utils-20070216.jar:na] at
org.xwiki.filter.xml.internal.output.FilterStreamXMLStreamWriter.writeCharacters(FilterStreamXMLStreamWriter.java:156)
~[xwiki-commons-filter-xml-7.4.1.jar:na] ... 72 common frames omitted Caused by: java.io.IOException: Invalid white space character (0x1) in text to output (in xml 1.1, could output as a character entity) at
com.ctc.wstx.api.InvalidCharHandler$FailingHandler.convertInvalidChar(InvalidCharHandler.java:55)
~[woodstox-core-asl-4.4.1.jar:4.4.1] at com.ctc.wstx.sw.XmlWriter.handleInvalidChar(XmlWriter.java:629) ~[woodstox-core-asl-4.4.1.jar:4.4.1] at
com.ctc.wstx.sw.BufferingXmlWriter.writeCharacters(BufferingXmlWriter.java:586)
~[woodstox-core-asl-4.4.1.jar:4.4.1] at
com.ctc.wstx.sw.BaseStreamWriter.writeCharacters(BaseStreamWriter.java:456)
~[woodstox-core-asl-4.4.1.jar:4.4.1] ... 74 common frames omitted _______________________________________________ users mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/users -- Thomas Mortagne -- Thomas Mortagne -- Thomas Mortagne
users mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/users
_______________________________________________ users mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/users
Peter John Acklam <mailto:[email protected]> 22 February 2016 at 12:46 Avoiding this problem in the future would be nice, but I already have this character in my wiki, and I need to get rid of it. I don't know how it got there, but more importantly, I need to find it, so I can remove it. With no XAR export, we can't do our planned transision from an Oracle to a PostgreSQL database.
As for the discussion on markmail.org – I have registered there, but I can't find anything on the webpage that allows me to take part in the discussion.
Cheers, Peter
_______________________________________________ users mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/users Thomas Mortagne <mailto:[email protected]> 22 February 2016 at 12:15 Starting a discussion on this subject on http://markmail.org/message/32vnzxchphr26phh.
If you have more input on what is this character doing here please share there.
On Mon, Feb 22, 2016 at 11:55 AM, Thomas Mortagne