[xwiki-devs] [Discussion][Update] Wiki Importer
Hi Devs, I would like to improve Wiki Importer sandbox project, by making few changes to the design to widen it scope of usage, and make sure its useful to the community. In the existing one ( http://svn.xwiki.org/svnroot/xwiki/contrib/sandbox/xwiki-wikiimporter/), I have implemented import from MediaWiki XML. Limitations: * listener implementation is tightly coupled with storage ( Importing/Saving pages or other objects into XWiki). * listener doesnt include all the xwiki related events. * No separate storage component, that can enable both imports and exports ( e.g. export the parsed content into XAR ). Existing documentation on WikiImporter : http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/WebHome http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/Wiki+Import... Can i move the design documentation to Design Proposal wiki.? As Thomas suggested, it will be good to rename wiki importer to converter as it is not limited to importing only, So am planning to change it to WikiConverter. WDYT? Arun Reddy Arun Reddy
Hi Arun, On Mar 20, 2011, at 1:32 PM, [email protected] wrote:
Hi Devs,
I would like to improve Wiki Importer sandbox project, by making few changes to the design to widen it scope of usage, and make sure its useful to the community.
Great!
In the existing one ( http://svn.xwiki.org/svnroot/xwiki/contrib/sandbox/xwiki-wikiimporter/), I have implemented import from MediaWiki XML.
Limitations: * listener implementation is tightly coupled with storage ( Importing/Saving pages or other objects into XWiki). * listener doesnt include all the xwiki related events. * No separate storage component, that can enable both imports and exports ( e.g. export the parsed content into XAR ).
Existing documentation on WikiImporter : http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/WebHome http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/Wiki+Import...
Can i move the design documentation to Design Proposal wiki.?
Definitely.
As Thomas suggested, it will be good to rename wiki importer to converter as it is not limited to importing only, So am planning to change it to WikiConverter.
WDYT?
Sounds good to me although I don't know enough to judge. I liked importer since I thought it was about importer data from another wiki into XWiki. What other features is there? Thanks -Vincent
On Sun, Mar 20, 2011 at 13:45, Vincent Massol <[email protected]> wrote:
Hi Arun,
On Mar 20, 2011, at 1:32 PM, [email protected] wrote:
Hi Devs,
I would like to improve Wiki Importer sandbox project, by making few changes to the design to widen it scope of usage, and make sure its useful to the community.
Great!
In the existing one ( http://svn.xwiki.org/svnroot/xwiki/contrib/sandbox/xwiki-wikiimporter/), I have implemented import from MediaWiki XML.
Limitations: * listener implementation is tightly coupled with storage ( Importing/Saving pages or other objects into XWiki). * listener doesnt include all the xwiki related events. * No separate storage component, that can enable both imports and exports ( e.g. export the parsed content into XAR ).
Existing documentation on WikiImporter : http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/WebHome http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/Wiki+Import...
Can i move the design documentation to Design Proposal wiki.?
+1
Definitely.
As Thomas suggested, it will be good to rename wiki importer to converter as it is not limited to importing only, So am planning to change it to WikiConverter.
WDYT?
Sounds good to me although I don't know enough to judge. I liked importer since I thought it was about importer data from another wiki into XWiki. What other features is there?
Millions of features ;) At first yes but it became an event system where you can have some exported wiki as input and a db importer as output. But you could also change the output for a car exported for example. And ad input you can have a database reader, etc... Basically the goal is to do the new XWiki import/export system as well as a lots of use case like migrate a wiki by puting a REST importer as input and a database writer as output, etc... Importing other wikis would be just one use case among others.
Thanks -Vincent _______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
-- Thomas Mortagne
Hi Vincent, On Sun, Mar 20, 2011 at 6:15 PM, Vincent Massol <[email protected]> wrote:
Hi Arun,
On Mar 20, 2011, at 1:32 PM, [email protected] wrote:
Hi Devs,
I would like to improve Wiki Importer sandbox project, by making few changes to the design to widen it scope of usage, and make sure its useful to the community.
Great!
In the existing one ( http://svn.xwiki.org/svnroot/xwiki/contrib/sandbox/xwiki-wikiimporter/), I have implemented import from MediaWiki XML.
Limitations: * listener implementation is tightly coupled with storage ( Importing/Saving pages or other objects into XWiki). * listener doesnt include all the xwiki related events. * No separate storage component, that can enable both imports and exports ( e.g. export the parsed content into XAR ).
Existing documentation on WikiImporter : http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/WebHome
http://gsoc.myxwiki.org/xwiki/bin/view/Import+Export+other+wikis/Wiki+Import...
Can i move the design documentation to Design Proposal wiki.?
Definitely.
As Thomas suggested, it will be good to rename wiki importer to converter as it is not limited to importing only, So am planning to change it to WikiConverter.
WDYT?
Sounds good to me although I don't know enough to judge. I liked importer since I thought it was about importer data from another wiki into XWiki. What other features is there?
Apart from trivial features like import from filesystem, webservice ... 1. Extension manager can use this api to parse the XAR file. (Suggested by Thomas ). 2. Instead of importing another wiki to XWiki, we can parse the content and export it as XAR, which can be imported to another xwiki instance. 3. Imports and exports from XWiki to XWiki. Its like there will be a Wiki Converter API which parses different export types (e.g. XML dumps, database dumps, URL .. ) and fires XWiki related events. these events can be used by XWiki-importer, XWiki-exporter, extension manager to get its job done. So, i would like to keep wiki converter, importer and exporter ... as different modules. What do yo suggest ? Thanks
-Vincent _______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
Thanks Arun
Hi Arun, I'm not sure if you are already aware of this but I used some bits of wiki importer code on one of XWiki SAS client projects which involved importing a mediawiki into XWiki. I think I did a lot of custom coding in groovy and IIRC what I did is too mediawiki specific, but you might still be able to grab something out of it. Please check with Ludovic for the code I developed. Thanks. - Asiri
On Sun, Mar 20, 2011 at 18:48, Asiri Rathnayake <[email protected]> wrote:
Hi Arun,
I'm not sure if you are already aware of this but I used some bits of wiki importer code on one of XWiki SAS client projects which involved importing a mediawiki into XWiki. I think I did a lot of custom coding in groovy and IIRC what I did is too mediawiki specific, but you might still be able to grab something out of it. Please check with Ludovic for the code I developed.
Asiri, I had to do the same thing for XWiki SAS after you and made the wikiimporter evolve a lot for this with all the needed refactoring etc... so the current source is already pretty close to what Arun is talking about.
Thanks.
- Asiri _______________________________________________ devs mailing list [email protected] http://lists.xwiki.org/mailman/listinfo/devs
-- Thomas Mortagne
Hi, On Sun, Mar 20, 2011 at 7:23 PM, Thomas Mortagne <[email protected]>wrote:
On Sun, Mar 20, 2011 at 18:48, Asiri Rathnayake <[email protected]> wrote:
Hi Arun,
I'm not sure if you are already aware of this but I used some bits of wiki importer code on one of XWiki SAS client projects which involved importing a mediawiki into XWiki. I think I did a lot of custom coding in groovy and IIRC what I did is too mediawiki specific, but you might still be able to grab something out of it. Please check with Ludovic for the code I developed.
Asiri, I had to do the same thing for XWiki SAS after you and made the wikiimporter evolve a lot for this with all the needed refactoring etc... so the current source is already pretty close to what Arun is talking about.
Cool! thanks for the clarification. - Asiri
Hi Asiri, On Sun, Mar 20, 2011 at 11:18 PM, Asiri Rathnayake < [email protected]> wrote:
Hi Arun,
I'm not sure if you are already aware of this but I used some bits of wiki importer code on one of XWiki SAS client projects which involved importing a mediawiki into XWiki. I think I did a lot of custom coding in groovy and IIRC what I did is too mediawiki specific, but you might still be able to grab something out of it. Please check with Ludovic for the code I developed.
I remember you have shared this with me, have considered it while developing the existing MediaWiki XML importer. Once again I shall check it out to make sure that I didnt miss anything. :)
Thanks.
- Asiri
Thanks Arun
participants (4)
-
Asiri Rathnayake -
Thomas Mortagne -
Vincent Massol -
vipunreddy.n＠gmail.com