[xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki
Hi, I'm in organization where we have 3 unsynchronized wikis, implemented using the software named in subject (ie JSPWiki/DokuWiki/mediawiki). I would like to merge their content in one unique wiki, obviously implemented using XWiki (due to the excellent interview Vincent Massol and Ludovic Dubost gave to the castcodeurs podcast). I have seen there are extensions to have content of those legacy wiki imported into XWiki. However, i'm not sure I understand how they work. 1 - JSPWiki to XWiki There seems to be an old (?) extension at http://extensions.xwiki.org/xwiki/bin/view/Extension/JSPWiki+To+XWiki+Conver..., documented by Vincent Massol. From what I understand, the Java code in this extension has to be compiled independently, and run as a stand-alone program on the machine hosting the JSPWiki server. It will generate a XAR that can be injected into XWiki. Am I right ? If so, it is hardly an extension of XWiki, but rather a companion program (but I'm nitpicking). However, as a stand-alone program, isn't it available as an executable JAR somewhere ? 2 - Dokuwiki to XWiki This time, it's a valid XWiki extension : http://extensions.xwiki.org/xwiki/bin/view/Extension/Import+DokuWiki+into+XW... which is easily installable using Extension manager (cool !). However, I wonder how it will work with XWiki 6.4.2 ... 3 - mediawiki to XWiki This time ... it seems like there is no extension. or is it ? bonus - xwiki-OLD to xwiki We also have some content in an old (5.0.1) version of XWiki. How do I migrate ? Conclusion - cheers I must confess I had never tried before XWiki, and my first impression is that it's a robust and perfectly usable wiki solution. The XWiki team did a really impressive work. -- Nicolas Delsaux
Hi Nicolas, On 19 Mar 2015 at 15:38:02, Nicolas Delsaux ([email protected](mailto:[email protected])) wrote:
Hi, I'm in organization where we have 3 unsynchronized wikis, implemented using the software named in subject (ie JSPWiki/DokuWiki/mediawiki). I would like to merge their content in one unique wiki, obviously implemented using XWiki (due to the excellent interview Vincent Massol and Ludovic Dubost gave to the castcodeurs podcast).
Nice choice! :)
I have seen there are extensions to have content of those legacy wiki imported into XWiki. However, i'm not sure I understand how they work.
I don’t know if you’ve seen this doc page which may provide a bit more information: http://platform.xwiki.org/xwiki/bin/view/Features/Imports#HImportingfromanot...
1 - JSPWiki to XWiki
There seems to be an old (?) extension at http://extensions.xwiki.org/xwiki/bin/view/Extension/JSPWiki+To+XWiki+Conver..., documented by Vincent Massol. From what I understand, the Java code in this extension has to be compiled independently, and run as a stand-alone program on the machine hosting the JSPWiki server. It will generate a XAR that can be injected into XWiki. Am I right ? If so, it is hardly an extension of XWiki, but rather a companion program (but I'm nitpicking). However, as a stand-alone program, isn't it available as an executable JAR somewhere ?
Yes, this is an old script written a long time ago (not by me, I just made it available on that page ;)), before XWiki Rendering (see http://rendering.xwiki.org) existed. I have no idea how well it works.
2 - Dokuwiki to XWiki
This time, it's a valid XWiki extension : http://extensions.xwiki.org/xwiki/bin/view/Extension/Import+DokuWiki+into+XW... which is easily installable using Extension manager (cool !). However, I wonder how it will work with XWiki 6.4.2 ...
3 - mediawiki to XWiki
This time ... it seems like there is no extension. or is it ?
So to summarize, we’re lacking some nice migrators to migrate from all those wikis to XWiki. We only have scripts maintained by the community. Now we’ve put in place all the infrastructure for such a migrator. We call it the Filters Application (a bad name IMO but it does more than just migrate content from wiki to wikis, it accepts any input and any output). See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application Right now this Filters app supports only a few input/outputs: http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExisting... Since there’s a confluence input module, it means you can give this Filter app a confluence zip as input and as output you can put an XWiki instance and it’ll import the content. We’re lacking input modules for the wikis you mentioned above: JSPWiki, Dokuwiki and MediaWiki. So there are 4 solutions I can see at this stage: * You import your content page by page (since XWiki can read natively the formats of the wikis you mentioned) * You use one of the extension scripts from http://extensions.xwiki.org/xwiki/bin/view/Main/Tags?do=viewTag&tag=migratio... but I don’t know what result you’ll get (I’ve never used them myself but I think the mediawiki ones are pretty good) * You want to contribute/participate and we can guide you on how to write a Filter module. If you wish to see the code for the confluence one, it’s here: https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwik... * You want someone to do the work for you! Check the list of professional services at http://www.xwiki.org/xwiki/bin/view/Main/Support#HProfessionalSupport
bonus - xwiki-OLD to xwiki
We also have some content in an old (5.0.1) version of XWiki. How do I migrate ?
That’s relatively easy :) You can export and reimport for example, see http://platform.xwiki.org/xwiki/bin/view/AdminGuide/ImportExport
Conclusion - cheers
I must confess I had never tried before XWiki, and my first impression is that it's a robust and perfectly usable wiki solution. The XWiki team did a really impressive work.
Thanks, I hope you’ll enjoy it! -Vincent
Nicolas Delsaux
On Thu, Mar 19, 2015 at 3:37 PM, Nicolas Delsaux <[email protected]> wrote:
Hi, I'm in organization where we have 3 unsynchronized wikis, implemented using the software named in subject (ie JSPWiki/DokuWiki/mediawiki). I would like to merge their content in one unique wiki, obviously implemented using XWiki (due to the excellent interview Vincent Massol and Ludovic Dubost gave to the castcodeurs podcast). I have seen there are extensions to have content of those legacy wiki imported into XWiki. However, i'm not sure I understand how they work.
1 - JSPWiki to XWiki
There seems to be an old (?) extension at http://extensions.xwiki.org/xwiki/bin/view/Extension/JSPWiki+To+XWiki+Conver..., documented by Vincent Massol. From what I understand, the Java code in this extension has to be compiled independently, and run as a stand-alone program on the machine hosting the JSPWiki server. It will generate a XAR that can be injected into XWiki. Am I right ? If so, it is hardly an extension of XWiki, but rather a companion program (but I'm nitpicking). However, as a stand-alone program, isn't it available as an executable JAR somewhere ?
2 - Dokuwiki to XWiki
This time, it's a valid XWiki extension : http://extensions.xwiki.org/xwiki/bin/view/Extension/Import+DokuWiki+into+XW... which is easily installable using Extension manager (cool !). However, I wonder how it will work with XWiki 6.4.2 ...
3 - mediawiki to XWiki
This time ... it seems like there is no extension. or is it ?
Looks like there is http://extensions.xwiki.org/xwiki/bin/view/Extension/Mediawiki+To+XWiki+Migr.... Last time I had to do that (a long time ago) I used https://github.com/xwiki-contrib/sandbox/tree/master/xwiki-wikiimporter.
bonus - xwiki-OLD to xwiki
We also have some content in an old (5.0.1) version of XWiki. How do I migrate ?
Conclusion - cheers
I must confess I had never tried before XWiki, and my first impression is that it's a robust and perfectly usable wiki solution. The XWiki team did a really impressive work.
-- Nicolas Delsaux _______________________________________________ users mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/users
-- Thomas Mortagne
Le 19/03/2015 16:10, [email protected] a écrit :
Nice choice! :) Yeah, for now, as I'm only evaluating it, I'm rather happy. Yes, this is an old script written a long time ago (not by me, I just made it available on that page ;)), before XWiki Rendering (see http://rendering.xwiki.org) existed. I have no idea how well it works. My concern about this script is that its status regarding full wiki import is ... undetermined.
So to summarize, we’re lacking some nice migrators to migrate from all those wikis to XWiki. We only have scripts maintained by the community.
Now we’ve put in place all the infrastructure for such a migrator. We call it the Filters Application (a bad name IMO but it does more than just migrate content from wiki to wikis, it accepts any input and any output). See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application
Right now this Filters app supports only a few input/outputs: http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExisting...
Since there’s a confluence input module, it means you can give this Filter app a confluence zip as input and as output you can put an XWiki instance and it’ll import the content.
So, from what I understand, my "best" solution would be to write extensions to the filter module supporting JSPWiki and Dokuwiki. I could/should rely upon the Rendering framework which seems to understand both syntaxes with ease. Am I right ? And if so, what would be, to your mind, the estimated duration of such a development ? Thanks anyway for the answer. -- Nicolas Delsaux
On Mon, Mar 23, 2015 at 11:02 AM, Nicolas Delsaux <[email protected]> wrote:
Le 19/03/2015 16:10, [email protected] a écrit :
Nice choice! :)
Yeah, for now, as I'm only evaluating it, I'm rather happy.
Yes, this is an old script written a long time ago (not by me, I just made it available on that page ;)), before XWiki Rendering (see http://rendering.xwiki.org) existed. I have no idea how well it works.
My concern about this script is that its status regarding full wiki import is ... undetermined.
So to summarize, we’re lacking some nice migrators to migrate from all those wikis to XWiki. We only have scripts maintained by the community.
Now we’ve put in place all the infrastructure for such a migrator. We call it the Filters Application (a bad name IMO but it does more than just migrate content from wiki to wikis, it accepts any input and any output). See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application
Right now this Filters app supports only a few input/outputs:
http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExisting...
Since there’s a confluence input module, it means you can give this Filter app a confluence zip as input and as output you can put an XWiki instance and it’ll import the content.
So, from what I understand, my "best" solution would be to write extensions to the filter module supporting JSPWiki and Dokuwiki. I could/should rely upon the Rendering framework which seems to understand both syntaxes with ease.
Am I right ? And if so, what would be, to your mind, the estimated duration of such a development ?
This is the best long term solution yes and you benefit from all the work done for other importer for all the bulletproofing in instance output filter. You can look at the module in https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwik... for inspiration. For the estimated duration I don't really know since most of the time depend on the format you are going to read and find a suitable replacement in the existing generic events. I spend 90% of my time just trying to understand the format when I did the Confluence module and there is still possible improvements but I'm sure you can't have a format that horrible in dokuwiki and jspwiki. Dokuwiki should not be too hard unless there is a lot of new features to find equivalent to compared to the last time I used it. I don't know JSPWiki except by name so not much idea here. A note on the existing syntaxes parsers in the rendering for dokuwiki and jspwiki: there is a few tests but those are not the most tested modules so you might find some differences compared to the standard behavior in the last version of dokuwiki and jspwiki.
Thanks anyway for the answer.
-- Nicolas Delsaux _______________________________________________ users mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/users
-- Thomas Mortagne
Actually I did not looked if there was a parser for dokuwiki and jspwiki but I guess you can reuse a parser done for one of the existing extensions. On Mon, Mar 23, 2015 at 3:07 PM, Thomas Mortagne <[email protected]> wrote:
On Mon, Mar 23, 2015 at 11:02 AM, Nicolas Delsaux <[email protected]> wrote:
Le 19/03/2015 16:10, [email protected] a écrit :
Nice choice! :)
Yeah, for now, as I'm only evaluating it, I'm rather happy.
Yes, this is an old script written a long time ago (not by me, I just made it available on that page ;)), before XWiki Rendering (see http://rendering.xwiki.org) existed. I have no idea how well it works.
My concern about this script is that its status regarding full wiki import is ... undetermined.
So to summarize, we’re lacking some nice migrators to migrate from all those wikis to XWiki. We only have scripts maintained by the community.
Now we’ve put in place all the infrastructure for such a migrator. We call it the Filters Application (a bad name IMO but it does more than just migrate content from wiki to wikis, it accepts any input and any output). See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application
Right now this Filters app supports only a few input/outputs:
http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExisting...
Since there’s a confluence input module, it means you can give this Filter app a confluence zip as input and as output you can put an XWiki instance and it’ll import the content.
So, from what I understand, my "best" solution would be to write extensions to the filter module supporting JSPWiki and Dokuwiki. I could/should rely upon the Rendering framework which seems to understand both syntaxes with ease.
Am I right ? And if so, what would be, to your mind, the estimated duration of such a development ?
This is the best long term solution yes and you benefit from all the work done for other importer for all the bulletproofing in instance output filter.
You can look at the module in https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwik... for inspiration.
For the estimated duration I don't really know since most of the time depend on the format you are going to read and find a suitable replacement in the existing generic events. I spend 90% of my time just trying to understand the format when I did the Confluence module and there is still possible improvements but I'm sure you can't have a format that horrible in dokuwiki and jspwiki. Dokuwiki should not be too hard unless there is a lot of new features to find equivalent to compared to the last time I used it. I don't know JSPWiki except by name so not much idea here.
A note on the existing syntaxes parsers in the rendering for dokuwiki and jspwiki: there is a few tests but those are not the most tested modules so you might find some differences compared to the standard behavior in the last version of dokuwiki and jspwiki.
Thanks anyway for the answer.
-- Nicolas Delsaux _______________________________________________ users mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/users
-- Thomas Mortagne
-- Thomas Mortagne
On 23 Mar 2015 at 15:07:41, Thomas Mortagne ([email protected](mailto:[email protected])) wrote:
On Mon, Mar 23, 2015 at 11:02 AM, Nicolas Delsaux wrote:
Le 19/03/2015 16:10, [email protected] a écrit :
Nice choice! :)
Yeah, for now, as I'm only evaluating it, I'm rather happy.
Yes, this is an old script written a long time ago (not by me, I just made it available on that page ;)), before XWiki Rendering (see http://rendering.xwiki.org) existed. I have no idea how well it works.
My concern about this script is that its status regarding full wiki import is ... undetermined.
So to summarize, we’re lacking some nice migrators to migrate from all those wikis to XWiki. We only have scripts maintained by the community.
Now we’ve put in place all the infrastructure for such a migrator. We call it the Filters Application (a bad name IMO but it does more than just migrate content from wiki to wikis, it accepts any input and any output). See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application
Right now this Filters app supports only a few input/outputs:
http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExisting...
Since there’s a confluence input module, it means you can give this Filter app a confluence zip as input and as output you can put an XWiki instance and it’ll import the content.
So, from what I understand, my "best" solution would be to write extensions to the filter module supporting JSPWiki and Dokuwiki. I could/should rely upon the Rendering framework which seems to understand both syntaxes with ease.
Am I right ? And if so, what would be, to your mind, the estimated duration of such a development ?
This is the best long term solution yes and you benefit from all the work done for other importer for all the bulletproofing in instance output filter.
You can look at the module in https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwik... for inspiration.
For the estimated duration I don't really know since most of the time depend on the format you are going to read and find a suitable replacement in the existing generic events. I spend 90% of my time just trying to understand the format when I did the Confluence module and there is still possible improvements but I'm sure you can't have a format that horrible in dokuwiki and jspwiki. Dokuwiki should not be too hard unless there is a lot of new features to find equivalent to compared to the last time I used it. I don't know JSPWiki except by name so not much idea here.
A note on the existing syntaxes parsers in the rendering for dokuwiki and jspwiki: there is a few tests but those are not the most tested modules so you might find some differences compared to the standard behavior in the last version of dokuwiki and jspwiki.
Actually we don’t have any parser for the dokuwiki syntax in XWiki Rendering so the work to support Dokuwiki is not small (first someone needs to add support for it syntax in XWiki Rendering and then only we can implement a wiki importer for it). For JSPWiki and MediaWiki it’s less work. Thanks -Vincent
Thanks anyway for the answer.
-- Nicolas Delsaux
participants (3)
-
Nicolas Delsaux -
Thomas Mortagne -
vincent＠massol.net