May 2010 - xwiki-devs@xwiki.org

[xwiki-devs] [Proposal] Rights Management UI
by Ecaterina Valica 10 Jun '10

10 Jun '10

Hi, Please give feedback for Rights Management UI Proposal. *Partial Prototype* - Wiki Level: http://incubator.myxwiki.org/xwiki/bin/view/Improvements/Rights2Wiki - Space Level: http://incubator.myxwiki.org/xwiki/bin/view/Improvements/Rights2Space - Page Level: http://incubator.myxwiki.org/xwiki/bin/view/Improvements/Rights2Page *Desired Interaction * - http://incubator.myxwiki.org/xwiki/bin/view/Improvements/Rights2Proposal#HI… Thanks, Caty

8 36

[xwiki-devs] [Proposal] A private security mailing list
by Alex Busenius 01 Jun '10

01 Jun '10

Hello devs, I propose to introduce a security mailing list (security(a)xwiki.org) to discuss details of security issues. This list should be private, with only committers and trusted contributors having read and write access. Anyone who proved his good intentions on the dev-list and bug tracker should be able to get access to security-list through the usual vote procedure. The purpose of this list is to give a safe place to discuss details open security issues without giving all script kiddies in the world examples to write exploits. The discussions should be kept on this private list until the corresponding fix is released. WDYT? Alex

11 24

[xwiki-devs] Access to the security mailing list
by Alex Busenius 31 May '10

31 May '10

Hello devs, I'd like to have access to the security mailing list :) Thanks, Alex

1 0

Re: [xwiki-devs] [xwiki-notifications] r29043 - in platform: core/trunk/xwiki-core core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/user/impl/xwiki core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/web web/trunk/standard/src/main/webapp/WEB-INF
by Vincent Massol 31 May '10

31 May '10

Hi Asiri, Some comments below. On May 28, 2010, at 1:03 PM, asiri (SVN) wrote: > Author: asiri > Date: 2010-05-28 13:03:53 +0200 (Fri, 28 May 2010) > New Revision: 29043 > > Added: > platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/web/TempResourceAction.java > Modified: > platform/core/trunk/xwiki-core/pom.xml > platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/user/impl/xwiki/XWikiRightServiceImpl.java > platform/web/trunk/standard/src/main/webapp/WEB-INF/struts-config.xml > Log: > XWIKI-5227: Introduce a temp resource action. > > * Applying patch after review, refer http://jira.xwiki.org/jira/browse/XWIKI-5227 for more details. > > > Modified: platform/core/trunk/xwiki-core/pom.xml > =================================================================== > --- platform/core/trunk/xwiki-core/pom.xml 2010-05-28 09:34:16 UTC (rev 29042) > +++ platform/core/trunk/xwiki-core/pom.xml 2010-05-28 11:03:53 UTC (rev 29043) > @@ -257,6 +257,13 @@ > <groupId>commons-beanutils</groupId> > <artifactId>commons-beanutils</artifactId> > </dependency> > + > +  > + <dependency> > + <groupId>org.apache.tika</groupId> > + <artifactId>tika-core</artifactId> > + <version>0.7</version> > + </dependency> > >  > <dependency> > > Modified: platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/user/impl/xwiki/XWikiRightServiceImpl.java > =================================================================== > --- platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/user/impl/xwiki/XWikiRightServiceImpl.java 2010-05-28 09:34:16 UTC (rev 29042) > +++ platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/user/impl/xwiki/XWikiRightServiceImpl.java 2010-05-28 11:03:53 UTC (rev 29043) > @@ -137,6 +137,7 @@ > actionMap.put("jsx", "view"); > actionMap.put("ssx", "view"); > actionMap.put("tex", "view"); > + actionMap.put("temp", "view"); why "temp" and not "tmp"? > actionMap.put("unknown", "view"); > } > > > Added: platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/web/TempResourceAction.java > =================================================================== > --- platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/web/TempResourceAction.java (rev 0) > +++ platform/core/trunk/xwiki-core/src/main/java/com/xpn/xwiki/web/TempResourceAction.java 2010-05-28 11:03:53 UTC (rev 29043) > @@ -0,0 +1,128 @@ > +/* > + * See the NOTICE file distributed with this work for additional > + * information regarding copyright ownership. > + * > + * This is free software; you can redistribute it and/or modify it > + * under the terms of the GNU Lesser General Public License as > + * published by the Free Software Foundation; either version 2.1 of > + * the License, or (at your option) any later version. > + * > + * This software is distributed in the hope that it will be useful, > + * but WITHOUT ANY WARRANTY; without even the implied warranty of > + * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU > + * Lesser General Public License for more details. > + * > + * You should have received a copy of the GNU Lesser General Public > + * License along with this software; if not, write to the Free > + * Software Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA > + * 02110-1301 USA, or see the FSF site: http://www.fsf.org. > + */ > +package com.xpn.xwiki.web; > + > +import java.io.File; > +import java.io.IOException; > +import java.net.URI; > +import java.util.regex.Matcher; > +import java.util.regex.Pattern; > + > +import org.apache.commons.io.FileUtils; > +import org.apache.commons.io.IOUtils; > +import org.apache.commons.logging.Log; > +import org.apache.commons.logging.LogFactory; > +import org.apache.tika.Tika; > +import org.apache.tika.mime.MimeTypes; > +import org.xwiki.container.Container; > + > +import com.xpn.xwiki.XWikiContext; > +import com.xpn.xwiki.XWikiException; > + > +/** > + * Action responsible for downloading temporary resources created by various modules. Refer JIRA issue: > + * <a>http://jira.xwiki.org/jira/browse/XWIKI-5227</a>. > + * > + * @version $Id$ > + * @since 2.4M1 > + */ > +public class TempResourceAction extends XWikiAction > +{ > + /** > + * URI pattern for this action. > + */ > + public static final Pattern URI_PATTERN = Pattern.compile(".*?/temp/([^/]*+)/([^/]*+)/([^/]*+)/(.*+)"); > + > + /** > + * Logging support. > + */ > + private static final Log LOG = LogFactory.getLog(TempResourceAction.class); > + > + /** > + * Used for detecting mime-types of files. > + */ > + private Tika tika = new Tika(); > + > + /** > + * Used to resolve temporary working dir. > + */ > + private Container container = Utils.getComponent(Container.class); > + > + /** > + * {@inheritDoc} > + */ > + public String render(XWikiContext context) throws XWikiException > + { > + XWikiRequest request = context.getRequest(); > + XWikiResponse response = context.getResponse(); > + String uri = request.getRequestURI(); > + > + // Locate the temporary file. > + File tempFile = getTempFile(uri); Using File is not recommended IMO. Couldn't you use a URL instead? > + if (null == tempFile) { > + throw new XWikiException(XWikiException.MODULE_XWIKI_APP, XWikiException.ERROR_XWIKI_APP_URL_EXCEPTION, > + "Invalid temporary resource URL"); > + } > + > + // Write temporary file into response. > + response.setDateHeader("Last-Modified", tempFile.lastModified()); > + String contentType = MimeTypes.OCTET_STREAM; > + try { > + contentType = tika.detect(tempFile); > + } catch (IOException ex) { > + LOG.warn(String.format("Unable to determine mime type for temporary resource [%s]", tempFile > + .getAbsolutePath()), ex); > + } > + response.setContentType(contentType); > + try { > + response.setContentLength((int) tempFile.length()); > + IOUtils.copy(FileUtils.openInputStream(tempFile), response.getOutputStream()); This is very bad for performance. You should stream the content instead. > + } catch (IOException e) { > + throw new XWikiException(XWikiException.MODULE_XWIKI_APP, > + XWikiException.ERROR_XWIKI_APP_SEND_RESPONSE_EXCEPTION, "Exception while sending response", e); > + } > + return null; > + } > + > + /** > + * Returns the temporary file corresponding to the specified URI. > + * > + * @param uri request URI. > + * @return temporary file corresponding to the specified URI or null if no such file can be located. > + */ > + private File getTempFile(String uri) I'd prefer a more explicit name such as getTemporaryFile() > + { > + Matcher matcher = URI_PATTERN.matcher(uri); > + File result = null; > + if (matcher.find()) { > + String space = matcher.group(1); > + String page = matcher.group(2); > + String module = matcher.group(3); > + String filePath = matcher.group(4); > + String prefix = String.format("temp/%s/%s/%s/", module, space, page); > + String path = URI.create(prefix + filePath).normalize().toString(); > + if (path.startsWith(prefix)) { > + result = new File(container.getApplicationContext().getTemporaryDirectory(), path); > + result = result.exists() ? result : null; > + } You should use the xwiki-url module to extract information from the URL IMO. It's much more complicated than what is written above. See code in xwiki-url for details. > + } > + return result; > + } > +} > > Modified: platform/web/trunk/standard/src/main/webapp/WEB-INF/struts-config.xml > =================================================================== > --- platform/web/trunk/standard/src/main/webapp/WEB-INF/struts-config.xml 2010-05-28 09:34:16 UTC (rev 29042) > +++ platform/web/trunk/standard/src/main/webapp/WEB-INF/struts-config.xml 2010-05-28 11:03:53 UTC (rev 29043) > @@ -257,6 +257,11 @@ > name="download" > scope="request"> > </action> > + <action path="/temp/" > + type="com.xpn.xwiki.web.TempResourceAction" > + name="temp" > + scope="request"> > + </action> > <action path="/downloadrev/" > type="com.xpn.xwiki.web.DownloadRevAction" > name="dowloadrev" Thanks -Vincent

2 3

[xwiki-devs] [vote] livetable select field default value should say 'All' and not 'none'
by Ludovic Dubost 31 May '10

31 May '10

Hi, I've created bug http://jira.xwiki.org/jira/browse/XWIKI-5229 because the livetable select field default value is not translatable and is not using a good term (as noticed by some heavy livetable users). I would like to propose we use "All" instead of "none" Here is my +1 Ludovic -- Ludovic Dubost Blog: http://blog.ludovic.org/ XWiki: http://www.xwiki.com Skype: ldubost GTalk: ldubost

6 6

[xwiki-devs] Xwiki/Jabber chat integration
by Khelifa BOUMAZA 30 May '10

30 May '10

Hi; I try to implement basic jabber chat based on · EJABBERD ( Jabber/XMPP instant messaging server) · JSJAC class ( jabber/XMPP client library written in JavaScript) · and XWIKI I confront two major problems · how to synchronize jabber users with Xwiki users · how get user chat status within xwiki page using velocity or groovy Any suggestions thx logoNearbee_CMJN BOUMAZA Khelifa Développeur WEB 15 rue Jean-Baptiste Berlier 75013 PARIS Tél :01.55.43.76.90 Fax : 01 55 43 76 96 <http://www.nearbee.com/> http://www.nearbee.com

3 2

[xwiki-devs] xwiki and social web screencast
by Story Henry 28 May '10

28 May '10

Hi, I put together a very short screen cast that shows how xwiki can be used on the social web. http://www.youtube.com/watch?v=8iZPJBpI2Po Certainly there can be improvements. For example one can't log into xwiki the way shown in the video yet. Henry Social Web Architect http://bblfish.net/

1 0

[xwiki-devs] [Proposal] Allow to provide document templates on document creation
by Jean-Vincent Drean 27 May '10

27 May '10

Hi XWikiers, I've been working on the ability to provide document templates on document creation lately. It's documented on dev.xwiki.org: http://dev.xwiki.org/xwiki/bin/view/Drafts/DocumentTemplates Implementation: - New "create" xwiki action - Templates: create.vm, createinline.vm (for inline and ajax uses) - Modification in the xwiki-core-rendering-xwiki core module so that it gets the correct action (create) for broken links - New XClass: XWiki.TemplateProviderClass (with associated sheet and template), this class allow to build the list of template entries to display in the create document form. - New administration section: Templates. Allows to list existing template providers and to create new ones. I'm almost ready to commit (I only need one more day to write functional tests) and I'd really like to do it after the 2.4M1 release. WDYT ? JIRA: http://jira.xwiki.org/jira/browse/XE-672 JV.

8 15

[xwiki-devs] Introduce new tempresource action
by Vincent Massol 26 May '10

26 May '10

Hi, Part I ===== I've started implementing a Ditaa Macro over the weekend (http://ditaa.sourceforge.net/ ) but we need an Action to return the Ditaa-generated image file. For the chart macro we're using the charting action but I think we can make this generic and instead introduce a tmp (or temp or tmpresource or ...) action instead that would return any resource located in the xwiki temporary directory. For ex: /xwiki/bin/tmp/SomeResource would return SomeResource found in container.getApplicationContext().getTemporaryDirectory(). Part II ===== The only thing to be careful about is to not be able to read what's for another user and for which you don't have access to see it. For example an image generated by the chart macro for a page for which the user doesn't have view rights. This can be partially solved by ensuring that file names include a generated token. However the pb is that this token cannot be unique since, for ex, generated image need to be shared to anyone having the rights to view a page. <brainstomring mode> A solution I see would be to include the "rights" to check + the full page name in the URL, in addition to the resource. For example: /xwiki/bin/tmp/view/wiki:Space.Page/SomeResource A more generic solution would be to add a notion of Check Handler, i.e. code that would perform the check. For example in the previous solution it's not possible to check for 2 permissions, nor any complex scheme. This would mean something like: /xwiki/bin/tmp/<check handler name>/<resource name>?<check params> Ex: /xwiki/bin/tmp/simple/SomeResource? checkPermission="view"&checkDocument="wiki:Space.Page" Implementation: A component with a role hint of "simple" would be looked-up and the check logic delegated to it. However someone could use a some check for a resource that wasn't meant to be used for that resource. Thus the check and its params should probably instead be included in the resource name with some algorithm instead. Thus the solution maybe to have a high level API to create a resource name and that API would take a Check Handler hint + some arbitrary params and that API would generate a resource name with these added. For ex something like:: "SomeResource-simple-view-wiki:Space.Page" (or any other format). Another solution would be to follow a completely different direction and for example to introduce a new XDOM representation for a TMP- image, i.e. in addition to URLImage and DocumentImage, to add a TemporaryImage implementation. </brainstomring mode> WDYT about these 2 ideas and especially about Part I since I would need that sooner rather than later to implement the Ditaa macro, and Part II is already a problem today. Thanks -Vincent

7 16

[xwiki-devs] On Security
by Andreas Jonsson 26 May '10

26 May '10

The work on the new right manager user interface looks very promising. Good work! But I also think that the underlying security model must urgently be revised. Although I must say that I love the idea that the users can write their own applications on top of XWiki, the current security just doesn't support this. When executing a script, who should be held accountable for the actions are taken by the script? In traditional operating systems, a user is expected to know and trust the programs that he or she chooses to run. Considering how much problems there are with "viruses" I'd say that this security model works badly in traditional environments. But in a wiki, scripts are executed at any page load. A user who casually browse the wiki cannot know when and what scripts are executed. Thus, it is a complete disaster to use a security model where the users are held accountable for whatever actions the script is doing. For instance, to take over a wiki that is open for anonymous commenting, just post a script that sits and waits for a user with admin or programming rights to view the page. How can the security model be fixed? There are two roles that should be considered involved in the execution of a script: user and programmer. Both the programmer and the user should be held accountable for whatever actions are taken by the script, but neither trust the other. The programmer says "go ahead and run this script, but you wont be able to do anything that you don't already have rights to". The user says "sure, I'll go ahead and run your script, but I don't give you any rights that you don't already have." Hence, a script should be executed with the intersection of the rights that the two roles possess. But it should be possible for a programmer that have carefully sanitized the user input to lend his or hers full privileges to the user. It should also be possible for users to indicate that they have reviewed a script and indicate that they trust a certain scripts or that they trust some programmer. In other words, the users should be able to lend their full rights to a particular script or to scripts written by a trusted programmer, when executed by the user. What about contents that is generated by a script? If the user who runs a script becomes the programmer of any scripts that are generated and saved, we have just added one level of indirection for attackers: An anonymous commenter could post a script that waits for an administrator. This script should in turn post a script (whos programmer would then be the administrator) that waits for an administrator. Since both user and programmer should be held accountable for the actions taken by a script, it might be reasonable that they are also both credited for any contents generated by the script. Thus both the user and the programmer could be considered "the programmer" for any new scripts generated by a script. But this might be unnecessarily complex. Instead, a distninction could be made on documents that is "saved with a programmer set" and those that are not. When rendering a document that does not have a programmer, all rights should be denied for scripts in the document. Saving a document with yourself as "the programmer" must not be allowed without first prompting the user for a confirmation, where the user must input a password. This to prevent attacks where the user is tricked into saving content with to the programmer set. How can this be implemented in XWiki? A document has a "creator", which is the person who saved the first revision of the document and each revision of the document has an "author", which is the person who saved the revision. We have to extend the document format to support a "programmer". "The user" is of course the logged in user that requests the page. The user is authenticated the ordinary way and both programmer (if any) and user is noted in the context. Thereafter any rights check is made by checking if both user and programmer has the right. If there is no programmer, all right checks should return "deny", except maybe for the "view"-right that should be checked against the user to allow the include macro without saving with a programmer. (But this opens up for an attack where page content which aren't viewable by everyone can be extracted, so maybe not. It could be a configurable option.) Obviously, it is important that comments to a page are not rendered with a programmer set. This will make it impossible to execute privileged scripts in comments. I don't think that is a useful feature, anyway. This will also require some additional user interaction. The default should be to not set any programmer when saving a document, and this will of course not require anything special from the user. But when saving a page, it should be possible to select "save with me set to the programmer". If the user chooses this option, she will be forwarded to a confirmation page "You are about to save this content with you set to the programmer. Please confirm by entering your save password." It should also be possible to select "save with me as programmer and lend my rights to users executing scripts in this page", whereupon the confirmation page should be marked with a big warning sign and contain a harsh lecture on sanitizing user input. It might be a good idea to introduce a special "save setuid" right that the user must have in order to at all be allowed to do this. A user that have programming rights should additionally have the option to set the programmer to an arbitrary user. A setuid script should, of course, have a programmer with as little privileges as possible. A set of dummy users with varying privileges could be prepared for this purpose. In order to allow saving documents with "the programmer" set in bulk (for instance in the import application), there should also be a confirmation page for allowing "saving with programmer set" throughout a request. Is this sufficient? Maybe. We have at least made it a lot harder for attackers, because now they must trick a privileged user to confirm a "save with myself as programmer". If the same password is used for saving pages as for logging in, this can be accomplished by spoofing a login-page. Thus, there should be a separate "save password" which must differ from the ordinary login password. It might even be possible to allow users to save javascript extensions. But there should at least be a configurable option to demand programming rights for this. Javascripts opens up many attack paths. Tasks: 1. Add "programmer" attribute to document. 2. Add "execute scripts with the programmers privilege (setuid)"-flag to document. 3. Change the RightService to: 1. if a programmer is not set, deny everything except "view", which (as a configurable wiki option) can be checked only for the user (to allow using the include macro without saving with a programmer), 2. check rights only for the programmer, if the setuid-flag is set, 3. check rights only for user, if the programmer is "trusted" or the user "trusts" the document, 4. check rights for both user and programmer, otherwise. Although the current right service implementation can be kludged into supporting this, it really needs to be rewritten from scratch, both for clarity and speed. The special treatment when the document author happens to have programming rights must be removed. How to determine if a programmer or the document is "trusted" is an open question, but I guess that users with programming or admin rights, at least, can be considered trusted. 4. Add "save password" to the user profile, which must be set to a non-empty string that differs from the login password for the user to be allowed to "save with myself as programmer" or "save setuid". 5. Add user interface controls for saving a page with programmer set. 6. Add confirmation page for confirming "save with myself as programmer". 7. Add user interface controls and confirmation page for "save setuid". 8. Add wiki-option to demand programming rights for saving javascript extensions. 9. Fix all applications that undoubtly will be broken by this change. Do you other people agree with me when I say that the security model must be replaced immediately? What do you think about my suggestion? Please, poke at it to try to find any attacks that I have not thought of. I have started on a new right service implementation with a cacheing front-end. I'll create a new module under core which I'll call 'xwiki-security' and move the right service to the new architecture while I'm at it. Best regards, Andreas Jonsson

3 5