23 Feb
2016
23 Feb
'16
9:25 a.m.
Hello all,
here would be the query:
select xwd_fullname from xwikidoc where xwd_content like
concat("%",char(1),"%");
(I've seen many indicate that || would be the concatenation operator,
but it seems like it is not the case in like operands)
Based on that, Peter, you should be able to filter things out.
Now, to the XML 1.1 export. In principle this is not a big deal, but we
should be clear on what it implies for parser libraries. The move to XML
1.1 has been more than frigid. Note also, that this support is pretty
limited (only &x references).
I'd prefer if we find a way to get rid of such gremlins. To my
experience they are only the spurious result of copy and paste. One
particular family of documents where these gremlins happen are PDF
documents generated by TeX. The venerable typesetting had a tradition of
funky encoding, since it also had its own fonts and all that was far
before the move even to 16 bits.
I believe that the editor or the save process should remove anything
below ASCII 32 except CR, LF, and TAB.
Can the migration process be interactive to ask about them?
Should we "just" zap them or replace them by a character?
Does someone find a reason to keep them?
Paul
PS: the "gremlins" name here comes from BBEdit/TextWrangler who had a
function "Zap Gremlins" since a decade at least.
Thomas Mortagne
<mailto:thomas.mortagne@xwiki.com>
22 February 2016 at 14:10
What I can say from the error is that the character is in a document
content at least (not a title, or an object) but it does not help much
reduce the scope.
You could try to find it with a SQL request I guess, need to find how
to search this specific character in a SQL request.
On Mon, Feb 22, 2016 at 2:01 PM, Thomas Mortagne
Thomas Mortagne <mailto:thomas.mortagne@xwiki.com>
22 February 2016 at 14:01
On Mon, Feb 22, 2016 at 12:46 PM, Peter John Acklam <pjacklam(a)gmail.com> wrote:
Avoiding this problem in the future would be
nice, but I already have this
character in my wiki, and I need to get rid of it. I don't know how it got
there, but more importantly, I need to find it, so I can remove it. With no
XAR export, we can't do our planned transision from an Oracle to a
PostgreSQL database.
As for the discussion on markmail.org – I have registered there, but I
can't find anything on the webpage that allows me to take part in the
discussion.
Yes you can't write from markmail, was probably not the best link to give :)
I think you can sent mails from nabble (through
http://dev.xwiki.org/xwiki/bin/view/Community/Forum or
http://xwiki.475771.n2.nabble.com/Should-we-move-to-XML-1-1-in-XAR-td759806…).
Cheers,
Peter
2016-02-22 12:15 GMT+01:00 Thomas Mortagne <thomas.mortagne(a)xwiki.com>om>:
Peter John Acklam <mailto:pjacklam@gmail.com>
22 February 2016 at 12:46
Avoiding this problem in the future would be nice, but I already have this
character in my wiki, and I need to get rid of it. I don't know how it got
there, but more importantly, I need to find it, so I can remove it.
With no
XAR export, we can't do our planned transision from an Oracle to a
PostgreSQL database.
As for the discussion on markmail.org – I have registered there, but I
can't find anything on the webpage that allows me to take part in the
discussion.
Cheers,
Peter
_______________________________________________
users mailing list
users(a)xwiki.org
http://lists.xwiki.org/mailman/listinfo/users
Thomas Mortagne <mailto:thomas.mortagne@xwiki.com>
22 February 2016 at 12:15
Starting a discussion on this subject on
http://markmail.org/message/32vnzxchphr26phh.
If you have more input on what is this character doing here please
share there.
On Mon, Feb 22, 2016 at 11:55 AM, Thomas Mortagne
Starting a discussion on this subject on
http://markmail.org/message/32vnzxchphr26phh.
If you have more input on what is this character doing here please share
there.
On Mon, Feb 22, 2016 at 11:55 AM, Thomas Mortagne
<thomas.mortagne(a)xwiki.com> wrote:
_______________________________________________
users mailing list
users(a)xwiki.org
http://lists.xwiki.org/mailman/listinfo/users Actually I do know why it's writting XML 1.0,
that's because we tell it
to...
Did not know XML 1.0 was not supporting anything,
I'm surprise we get
this kind of report only know.
Anyway thanks for the report, will take care of this.
On Mon, Feb 22, 2016 at 11:31 AM, Thomas Mortagne
<thomas.mortagne(a)xwiki.com> wrote:
> What I understand from the error message is that Woodstox think it's
> writing XML 1.0 and looks like it's not possible to put anything you
> want in XML 1.0 but not sure why exactly. You happen to have a
> document containing some weird character (0x1) which is probably a
> mistake but still we should be able to export anything (especially
> when this anything can be stored in a String and in the database).
>
> In the meantime what you can try is to set the old exporter in
> xwiki.cfg (look at xwiki.action.export.xar.usewikistream property).
> Would be great if you could crate an issue on http://jira.xwiki.org
> with all the information you can gather about this bug.
>
>
> On Mon, Feb 22, 2016 at 10:18 AM, Peter John Acklam <pjacklam(a)gmail.com>
wrote:
>> I can no longer make a XAR export of our
wiki. The essential error
message
>> in catalina.out seems to be
>>
>> "Invalid white space character (0x1) in text to output (in xml 1.1,
could
>> output as a character entity)"
>>
>> Alas, there is no information about which wiki page contains this
invalid
>> character. I can, of course, export parts
of the wiki and repeat the
>> process until I find the offending page, but I suspect there has got
to
be
>> a more efficient way.
>>
>> The full, relevant section of catalina.out on our test server is
included
>> below.
>>
>> Thanks in advance for any tips!
>>
>> Cheers,
>> Peter John Acklam
>>
>>
>> 2016-02-19 09:36:17,163 [
>>
http://wiki-test/xwiki/bin/export/XWiki/XWikiPreferences?editor=globaladmin…
]
>> WARN c.x.x.w.XWikiAction - Uncaught
exception: Error number 11015 in
11:
>> Exception while exporting
>> com.xpn.xwiki.XWikiException: Error number 11015 in 11: Exception while
>> exporting
>> at com.xpn.xwiki.web.ExportAction.render(ExportAction.java:84)
>> ~[xwiki-platform-legacy-oldcore-7.4.1.jar:na]
>> at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:417)
>> [xwiki-platform-legacy-oldcore-7.4.1.jar:na]
>> at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:184)
>> [xwiki-platform-legacy-oldcore-7.4.1.jar:na]
>> at
>>
org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:425)
>> [struts-core-1.3.10.jar:1.3.10]
>> at
>>
org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:228)
>> [struts-core-1.3.10.jar:1.3.10]
>> at
org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913)
>> [struts-core-1.3.10.jar:1.3.10]
>> at
org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:462)
>> [struts-core-1.3.10.jar:1.3.10]
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:648)
>> [servlet-api.jar:na]
>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
>> [servlet-api.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:291)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at com.xpn.xwiki.web.ActionFilter.doFilter(ActionFilter.java:115)
>> [xwiki-platform-legacy-oldcore-7.4.1.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
>>
org.xwiki.wysiwyg.server.filter.ConversionFilter.doFilter(ConversionFilter.java:127)
>>
[xwiki-platform-wysiwyg-server-7.4.1.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
>> [tomcat-websocket.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
>>
org.xwiki.container.servlet.filters.internal.SetHTTPHeaderFilter.doFilter(SetHTTPHeaderFilter.java:63)
>>
[xwiki-platform-container-servlet-7.4.1.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
>>
com.xpn.xwiki.plugin.webdav.XWikiDavFilter.doFilter(XWikiDavFilter.java:66)
>>
[xwiki-platform-webdav-server-7.4.1.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
>>
org.xwiki.container.servlet.filters.internal.SavedRequestRestorerFilter.doFilter(SavedRequestRestorerFilter.java:208)
>>
[xwiki-platform-container-servlet-7.4.1.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
>>
org.xwiki.container.servlet.filters.internal.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:111)
>>
[xwiki-platform-container-servlet-7.4.1.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
>>
org.xwiki.resource.servlet.RoutingFilter.doFilter(RoutingFilter.java:137)
>>
[xwiki-platform-resource-servlet-7.4.1.jar:na]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:212)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:106)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:141)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:616)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:88)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:521)
>> [catalina.jar:8.0.30]
>> at
>>
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1096)
>> [tomcat-coyote.jar:8.0.30]
>> at
>>
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:674)
>> [tomcat-coyote.jar:8.0.30]
>> at
>>
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1500)
>> [tomcat-coyote.jar:8.0.30]
>> at
>>
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1456)
>> [tomcat-coyote.jar:8.0.30]
>> at
>>
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> [na:1.8.0_66]
>> at
>>
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> [na:1.8.0_66]
>> at
>>
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
>> [tomcat-util.jar:8.0.30]
>> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]
>> Caused by: org.xwiki.filter.FilterException: Failed to write element
>> at
>>
org.xwiki.filter.xml.internal.output.FilterStreamXMLStreamWriter.writeCharacters(FilterStreamXMLStreamWriter.java:158)
>> ~[xwiki-commons-filter-xml-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.xml.internal.output.FilterStreamXMLStreamWriter.writeElement(FilterStreamXMLStreamWriter.java:145)
>> ~[xwiki-commons-filter-xml-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.xar.internal.output.XAROutputFilterStream.beginWikiDocumentRevision(XAROutputFilterStream.java:349)
>>
~[xwiki-platform-filter-stream-xar-7.4.1.jar:na]
>> at sun.reflect.GeneratedMethodAccessor601.invoke(Unknown Source)
~[na:na]
>> at
>>
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> ~[na:1.8.0_66]
>> at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_66]
>> at org.xwiki.filter.internal.FilterProxy.invoke(FilterProxy.java:90)
>> ~[xwiki-commons-filter-api-7.4.1.jar:na]
>> at org.xwiki.filter.internal.FilterProxy.invoke(FilterProxy.java:63)
>> ~[xwiki-commons-filter-api-7.4.1.jar:na]
>> at com.sun.proxy.$Proxy88.beginWikiDocumentRevision(Unknown Source)
~[na:na]
>> at
>>
org.xwiki.filter.instance.internal.input.XWikiDocumentLocaleEventGenerator.writeRevision(XWikiDocumentLocaleEventGenerator.java:167)
>>> ~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.XWikiDocumentLocaleEventGenerator.write(XWikiDocumentLocaleEventGenerator.java:116)
>>> ~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.XWikiDocumentLocaleEventGenerator.write(XWikiDocumentLocaleEventGenerator.java:55)
>>> ~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.AbstractBeanEntityEventGenerator.write(AbstractBeanEntityEventGenerator.java:114)
>>> ~[xwiki-platform-filter-instance-api-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.input.AbstractEntityEventGenerator.write(AbstractEntityEventGenerator.java:77)
>>> ~[xwiki-platform-filter-instance-api-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.DocumentInstanceInputEventGenerator.beginWikiDocument(DocumentInstanceInputEventGenerator.java:107)
>>> ~[xwiki-platform-filter-instance-oldcore-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.writeDocument(InstanceInputFilterStream.java:229)
>>> ~[xwiki-platform-filter-instance-api-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.writeSpace(InstanceInputFilterStream.java:195)
>>> ~[xwiki-platform-filter-instance-api-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.writeWiki(InstanceInputFilterStream.java:161)
>>> ~[xwiki-platform-filter-instance-api-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.read(InstanceInputFilterStream.java:130)
>>> ~[xwiki-platform-filter-instance-api-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.instance.internal.input.InstanceInputFilterStream.read(InstanceInputFilterStream.java:54)
>>> ~[xwiki-platform-filter-instance-api-7.4.1.jar:na]
>> at
>>
org.xwiki.filter.input.AbstractBeanInputFilterStream.read(AbstractBeanInputFilterStream.java:80)
>> ~[xwiki-commons-filter-api-7.4.1.jar:na]
>> at com.xpn.xwiki.web.ExportAction.exportXAR(ExportAction.java:337)
>> ~[xwiki-platform-legacy-oldcore-7.4.1.jar:na]
>> at com.xpn.xwiki.web.ExportAction.render(ExportAction.java:77)
>> ~[xwiki-platform-legacy-oldcore-7.4.1.jar:na]
>> ... 50 common frames omitted
>> Caused by: com.ctc.wstx.exc.WstxIOException: Invalid white space
character
>> (0x1) in text to output (in xml 1.1,
could output as a character
entity)
>> at
>>
com.ctc.wstx.sw.BaseStreamWriter.writeCharacters(BaseStreamWriter.java:458)
>>> ~[woodstox-core-asl-4.4.1.jar:4.4.1]
>> at
>>
javanet.staxutils.IndentingXMLStreamWriter.writeCharacters(IndentingXMLStreamWriter.java:209)
>>> ~[stax-utils-20070216.jar:na]
>> at
>>
org.xwiki.filter.xml.internal.output.FilterStreamXMLStreamWriter.writeCharacters(FilterStreamXMLStreamWriter.java:156)
>> ~[xwiki-commons-filter-xml-7.4.1.jar:na]
>> ... 72 common frames omitted
>> Caused by: java.io.IOException: Invalid white space character (0x1) in
text
>>> to output (in xml 1.1, could output as a character entity)
>> at
>>
com.ctc.wstx.api.InvalidCharHandler$FailingHandler.convertInvalidChar(InvalidCharHandler.java:55)
>>> ~[woodstox-core-asl-4.4.1.jar:4.4.1]
>>> at com.ctc.wstx.sw.XmlWriter.handleInvalidChar(XmlWriter.java:629)
>>> ~[woodstox-core-asl-4.4.1.jar:4.4.1]
>> at
>>
com.ctc.wstx.sw.BufferingXmlWriter.writeCharacters(BufferingXmlWriter.java:586)
>>> ~[woodstox-core-asl-4.4.1.jar:4.4.1]
>> at
>>
com.ctc.wstx.sw.BaseStreamWriter.writeCharacters(BaseStreamWriter.java:456)
>> ~[woodstox-core-asl-4.4.1.jar:4.4.1]
>> ... 74 common frames omitted
>> _______________________________________________
>> users mailing list
>> users(a)xwiki.org
>> http://lists.xwiki.org/mailman/listinfo/users
> --
> Thomas Mortagne
--
Thomas Mortagne
--
Thomas Mortagne
_______________________________________________
users mailing list
users(a)xwiki.org
http://lists.xwiki.org/mailman/listinfo/users