I can't help but observe the "discussion" underway with respect to spreadsheet interoperability that Rob Weir has started. Essentially Rob is complaining that Microsoft didn't implement the formula namespace of OpenOffice.
For the chair of the committee to post vitriol like this about the implementation of his own format raises a number of very concerning problems.
I'd like everyone reading the post to know that Rob was invited to participate in the DII events leading up to the SP2 release, and offered the opportunity to test the beta software specifically for the purpose of providing feedback on the implementation. Normally the chair of group of the standard being implemented would jump at the chance. Rob didn't, electing instead to wait for the shipping version and then claim that it is somehow deficient to other ODF implementations that he has deemed suitable for his purposes.
Does it make sense to have a chair for the ODF TC whose apparent mission is to create a caste system for ODF implementers? Do we really think Rob, who debates whether the tough (and publicly vetted) implementation decisions of his constituents are "malice" or "incompetence?" – is this the hallmark of a leader in the standards community striving for innovation using open technologies? Is this the characteristic that OASIS wants to promote in the development of technology standards? In Rob, do we really have a person capable of operating in a vendor-neutral forum? If departments within 18 various governments really do use ODF as their standard, should we be comfortable with an ODF TC chair that is trying very hard to discredit and divide its supporters?
Is it time for Rob to step down as chair? I think so.
I'm not saying Microsoft (or anyone) should be the chair instead, but I am saying that Rob is unfit as a leader given his inability to separate his personal venom from his role as a leader in driving the standard forward. It seems like a better approach to empower people on the ODF TC who have a long-term view of the need to enable interoperability, and to move those with more short-term vendor-oriented agendas to the side.
John Head is on point with this post. eWeek seems to be fine with SP2.
As far as I can see, the only thing that Rob is really demonstrating here is that the "grossly inadequate" formula support of ODF (those are the words of David Wheeler, leader of OpenFormula, read on for details) is causing problems with vendors implementing the standard. He instead resorts to scoring implementations based on a percentage of common ground, rather than conformance to something written on paper. This gives Rob the freedom he needs to define his own criteria for what ODF implementation is, and who is doing it according to his rules.
Rob seems to be positioning himself as the final arbiter on what is "good" ODF vs. "bad" ODF. OASIS? specification? – Unimportant when Rob Weir can arbitrarily define criteria for what he thinks is good. He's in a position where only he will declare his own ODF preferences as the blessed implementation. It seems that neither the ODF TC nor the spec matter anymore. It seems that ODF is being run by an individual.
Current ODF standards do not support formulas no matter how much Rob wishes it to be so. Implementations of ODF spreadsheets are application-dependent. ODF 1.2 is not an approved standard. OpenFormula is not an approved standard. While it may be that both are on a path to standardization in the future, today they are not. This is a situation that has been known to the ODF TC for more than 4 years, yet no solution based on an approved standard (other than Open XML) has been found. These are all indisputable facts.
In his post, Rob proposes using "legacy OO namespaces" (also declaring OpenOffice as the "current convention"). Rob's suggestion to use "legacy OO namespaces" is a reference to a vendor's product and indicates favoritism to a particular implementation. The defender of "precise, repeatable, common" seems to be abandoning that hill, hoping instead to claim for his own the dialog that Microsoft has been conducting for a long time: Interoperability requires the participation of many, and will not be defined by a standard alone. Doug covers that pretty well I think.
The irony isn't lost at all. This is the same guy who went to such a length to chastise Open XML for its undefined list styles and compatibility settings. For some reason his expectations of Open XML seem to be somewhat higher than they are for the committee he chairs. For some reason, it is ok for Rob to patch glaring holes in ODF as "current convention" and then complain vigorously about alleged dependence on Microsoft Office for implementing Open XML. This is shameful, hypocritical and warrants corrective action.
It wouldn't be such a huge deal if the tone were constructive or aimed at improving the situation. It seems he is only interested in distancing himself from scenarios where ODF can be used successfully with Microsoft Office (as well as the DII discussions where that implementation was discussed in detail during its development. Funny that he didn't show up there to share this feedback.)
Rob's conclusion on the cause of that problem:
"I was taught to never assume malice where incompetence would be the simpler explanation. But the degree of incompetence needed to explain SP2's poor ODF support boggles the mind and leads me to further uncharitable thoughts. So I must stop here"
Let's just remember that it was the ODF TC which deemed formulas "out of scope," and after 4 years, still have no solution for standardizing the definition of "Sum = 2+2." Rob says "Everyone knows what =A1+A2 means." Really Rob? What does it mean if A1 contains 1, and A2 contains "two"? Would it surprise you to learn that Excel and OpenOffice produce different answers in that case? Which one is correct? This question and a thousand more like it is why formula interoperability is hard work, and not at all the trivial matter Rob claims it is.
During the original discussion within the ODF TC, not everyone agreed with the omission of formulas from the spec… David Wheeler seemed to be pretty clear when commented on this on February 7th, 2005:
This previous comment scares me: "There are from our point of view also no interoperability issues, because the namespace prefix mechanism we have specified unambiguously specifies what syntax and semantics are used for a formula". Here's how I read that: "Every implementation must reverse engineer all other implementations' namespaces (they're not in the spec, so everyone's free to invent their own private incompatible namespaces). Then, every implementation must implement all the syntax and semantics of all other implementations' namespaces for formulas, if they wish to achive interoperability. And oh, by the way, your implementation might not implement the namespace for the document you're trying to load, so you may lose all the formulas."
I'm sure that's not what was meant, but that's how it reads to me. I hope that helps explain why I think that the current formula information in the OpenOffice specification is grossly inadequate."
So… maybe it's too easy, but "I was taught to never assume malice where incompetence would be the simpler explanation." David Wheeler saw this coming over 4 years ago, and yet, OpenFormula is not a standard today, and ODF has no definition for spreadsheet formulas. Rob tries to excuse his way around this in his post, but these comments are made by the committee that he chairs. I'll leave it to you, then, to decide between "malice" or "incompetence" of the poster who would elect to throw his own committee under the bus to get hits on his blog… or fail to take this very good advice.
By the way, it is worth noting the response to this stern (and very accurate) prediction.
"Hi David,Thanks for the concerned comments and all the considerable effort you have put into solving this problem. You're challenging us all to go where none have dared tread before. So go ahead and lead the way. You have the TC's attention. We are listening. As you grind out the grit of your proposal, please keep in mind that we have to fit proposed solutions into the politic of work that has already been done. A politic that represents years of work that is just now on it's way to ratification at OASIS, and beyond to ISO. Keep in mind also that the ISO certification comes at the request of the European Union. Time is of the essence. Ratification perhaps trumps perfection. At least for the moment."
This comment was from Gary Edwards, (he of "cracks in the foundation" / OpenDocument Foundation fame) who eventually left the TC and shuttered the OpenDocument Foundation. I seem to remember some dialog from Rob about Open XML being "rushed" through standardization. Funny how those things come back to haunt you.
I'm very discouraged by Rob's post. As far as I can tell, rob is playing a shell game where only his definition will be good enough for supporting ODF, and that definition will change to whatever Microsoft isn't doing.
This is far from constructive. This is not a way to foster interoperability and industry dialog. This is not a leader for people to follow.
@Bob Ross.
I have never met Peter Quinn, sorry. And I think that when it comes to ISO, Microsoft has not ever spoken negatively about ISO in the same fashion that folks like noooxml.org, boycottnovell.org, etc. We are definitely not the ones trashing ISO.
@Allin
I'm all for people speaking the truth. And believe me, we welcome the feedback on ODF. We WANT a good implementation. We would not have shown up to the TC if we didn't.
(and this helps me get back to the point of my post.) If ODF is intended to be a vendor-neutral format, then its chief champion and chair should act in a vendor-neutral fashion, rather than assigning labels to people like "Gnats," "Trolls" and "Incompetent." Regardless of how you might feel about the SP2 implementation of ODF, you can only view this as well below any professional behavior standard.
As for the "truth" -- make sure you read this as well. : http://blogs.msdn.com/dmahugh/:
From Doug's Post:
"So what do Symphony and Excel do about this challenge? The answer is that Symphony preserves the (unrecognized) formula markup, and Excel preserves the cached values. (A quick aside for those who don’t know: spreadsheets typically store both the formula and the value resulting from the most recent recalculation.)"
"So what does Rob’s test matrix show for these two scenarios? Oddly, it labels Open Office to IBM Lotus Symphony interoperability for this scenario as “OK” and it labels Open Office to Microsoft Office SP2 interoperability as “Fail” (with a red background for added emphasis). Now, I know Rob works for IBM and probably wants to portray Symphony in the best possible light, but is that a reasonable assessment of the interoperability we’ve just seen above?"
@Ian
"What I fail to understand is how this interoperability forum ended up with no spreadsheet formulae from Microsoft Office being readable by any other application?"
Perhaps because you were not there? -- (really, I'm not trying to wind you up here.) Please do attend DII to share your feedback and discuss the implementation. You will find people ready and willing to engage on the topics. This is what the forum is intended to surface.
http://www.documentinteropinitiative.org
@"Smion"
I will criticize Rob's unprofessional manner for pointing it out, thank you. As for the part about asking for input, we did (www.documentinteropinitiave.org) Rob was invited more than once, but elected not to attend. You are welcome to attend as well.
@Jose_X
"It surprises me that the Openoffice developers can figure out many details of Microsoft's closed formats [this requires a lot of hard work and desire for interoperability], "
And it surprises me even more that Rob's & Doug's tests are likely to have an "OK" mark in every table cell if binary formats were used instead of ODF.
And please remember back to the Open XML standardization process, where Microsoft and Open XML were so sharply criticized with this accusation: "one [supposedly] cannot implement Open XML using the specification alone."
So many people on my post (and Rob himself) are claiming that this is fine for ODF, but a reason to vote no on Open XML. It's too bad that this conversation seems to have a different set of rules based on the standard that is up for discussion.
@Rick, thank you for your comment. I appreciate the balance given the stream of Groklaw traffic to the post (currently about 80% of its hits).
For me this is all about conduct. The technical debate is one worth having. The DII is a great forum for sharing that feedback directly with those who are responsible for writing the code in Office.
@Jan, I'd say this is the reality we live in. There are implementations of ODF 1.2 (which is not a standard), IS26300, ODF 1.1. Standards evolve. Developers work to keep in touch with those evolutions.
@Jan, "Instead of bitching around, let's all move to productive mode and work on the technical problems by solving them to create true interoperability based on open standards."
We're in total agreement here. Let's make sure that for Open XML implementers and ODF implementers, we all have the same expectations for how that works. And please attend the DII to share your feedback with us in the future.
@Andrew Dar
"What seems painfully obvious to me however is that a large number of competing implementations appear to have achieved interoperability *despite the absence* of such definition. One of these implementations is even an existing plugin for MS Office. So it is demonstrably achievable."
-- yes, based on the implementation of a single product (OpenOffice). If it is not appropriate for Open XML implementers to be forced to achieve interoperability with Microsoft Office (As was claimed by Rob in the past on many occasions), it is not appropriate to expect ODF implementers be required to implement OpenOffice features either.
@Dirk
"You argue that this means I would favor one vendor (OpenOffice), whilst I would say that I'm looking there because in the ODF world, that is the most widely used program, and therefore I want to be sure I can at least make my software interoperate with that one. I think that makes perfect sense.
"
OpenOffice is not the most widely used program for Spreadsheets, and the "common convention" for ODF implementers is not based on the program that is most widely used.
Are you recommending that ODF implementers switch to using the Open XML implementation for formulas? -- (you said it, not me.) I don't think I would be THAT bold or foolish.
Why does ODF require implementers to mimic the behavior of a single application?
"I'd like everyone reading the post to know that Rob was invited to participate in the DII events"
Hey people ( Microsof ), why don't you try to work yourselves and stop asking help to people to do *basic* engineering tasks ?? this is not rocket science, just put square brackets in formulas ( you know, the "[" and "]" ... do you need the ascii/unicode codes? let me know ;-).
The same happened with the OOXML rush to standardization, at the end, lot of people around the world had to do your homework and ended generating lot of fixes/erratas/corrigenda/addenda ?
Leave the "workshops" for more advanced things , ok?
Just my humble take on this issue. Greatings from Argentina
Martin Elizondo ( SA )
@Martin, that's one way of looking at it. Or you could look at it in the way that we do. Microsoft is actively soliciting the participation of the community that is most vocal about their desire to see ODF implemented in Microsoft Office. -- wise for any software product to do... face to face discussion on feature requirements is a very good way to solicit feedback.
@Rick, I'll be explaining our approach to formulas in a blog post shortly, and how it interrelates to our guiding principles.
@Jan Wildeboer, the DII site currently documents the ECMA-376 implementation in Office 2007; before Office 2010 is available, the same site will document the IS29500 implementation in Office 2010. You're correct, the ECMA-376 spec on the DII site doesn't mention IS29500, because ECMA-376 was published two years before IS29500.
Why do you say "ultimately it is up to OASIS to announce their POV on the compliance of SP2's ODF implementation?" In actual fact, OASIS can not -- by their own rules -- do such a thing, for SP2 or any other implementation. Historically, you'll notice that has never happened.
@Jan
"Anyway, ultimately it is up to OASIS to announce their POV on the compliance of SP2's ODF implementation. The practical tests I have seen are however not really promising."
I think this is exactly what we're talking about in my post. The co-Chair of the ODF TC did exactly that.
Hmnn, let me see if I understand this:
* MS does a bad ODF implementation that will not allow
interoperability.
* Rob Weir points it out.
* Therefore, Weir must leave the committee.
Is it a necessity to have people in the committee that
silently accept MS' attempts at doing what - accept it -
we alredy know they have at least tried to do with things
like ... in example, Java? I disagree.