Regressions || Huston we have a problem

[Sebastian Sauer]

On Friday 15 July 2011 16:27:00 Thorsten Zachmann wrote:
> On Friday, July 15, 2011 13:52:26 Cyrille Berger Skott wrote:
> > On Friday 15 July 2011, Boudewijn Rempt wrote:
> > > On Friday 15 July 2011 Jul, Sebastian Sauer wrote:
> > > > Aloha,
> > > > 
> > > > yesterday at the ODF plugfest 2011 (
> > > > http://www.opendocsociety.org/news/2011- berlin-plugfest/ ) we had
> > > > two interoperability tests and failed on both of them. It seems both
> > > > where working at some point but cause of regressions didn't any
> > > > longer at the event. That is a problem.
> > > > 
> > > > Let me add that the problem are NOT the regressions. That can happen.
> > > > The problem is that we did not discover them for more then a month
> > > > till that event.
> > > > 
> > > > So, the question is how to improve that situation to make sure we are
> > > > able to discover regressions faster?
> > > > 
> > > > I see two ways;
> > > > 1. unittests also for saving.
> > > 
> > > We need those...
> > > 
> > > > 2. cstester roundtrips.
> > > 
> > > And those as well. Jos' server checks whether we can actually load all
> > > the kofficetests document, and even there we have failures.
> > 
> > jos's server does check whether it saves (and validation too I think ?).
> > I am trying to setup that on cruncher as well.
> > 
> > However, it mostly test if there are crashes, especially since we don't
> > have a proper way to validate the documents from calligra, since the
> > koffice and calligra extension namespace are not in the validation
> > schema, so someone would have to do that work.
> > 
> > But I guess it is also different of what Sebastian describe, for which we
> > need a volunteer to write the script that takes care of it.
> 
> If I can get informations on how to set it up on the server I can work on
> it. I will start with updating cstester so that roundtripping works as it
> should. Who should I contact about setting it up on the server?

If you need help please just ping me. Meanwhile I will look how to unittest 
roundtrips.