Tag: open standards

  • European Interoperability Framework 2.0

    This week, the European Commission announced an updated interoperability policy in the EU. The Commission has committed itself to adopt a Communication that introduces the European Interoperability Strategy (EIS) and an update to the European Interoperability Framework (EIF), “two key documents that promote interoperability among public administrations”, part of EUs Digital Agenda.

    Timeline for EUs interoperability work (from EIF2)

    I have followed, and been part of, the EU work on interoperability since the early days. I worked with the Bangemann Report during my PhD research. In the late 1990s, I worked for the Swedish government, and provided policy inputs to the Lisbon strategy. Fron 2001-2005, I worked for the Danish government, and was in the IDA workgroup that created EIF v1 in 2004. I also created the first Danish National Interoperability Framework (NIF). As the updated EIF notes, NIFs are “more detailed and often prescriptive than the EIF, which operates at a higher level of abstraction, as a ‘meta framework’ and, in line with the subsidiarity principle, does not impose specific choices or obligations on the Member States”.

    EIF v2 defines an interoperability framework as “an agreed approach to interoperability for organisations that wish to work together towards the joint delivery of public services”, and notes that “within its scope of applicability, it specifies a set of common elements such as vocabulary, concepts, principles, policies, guidelines, recommendations, standards, specifications and practices”.

    Quick overview of EIF v2

    Chapter 2, dealing with the ‘underlying principles’, sets out general principles underpinning European public services. For example:

    Underlying principle 7: Transparency

    Citizens and businesses should be able to understand administrative processes. They should have the right to track administrative procedures that involve them, and have insight into the rationale behind decisions that could affect them.

    Transparency also allows citizens and businesses to give feedback about the quality of the public services provided, to contribute to their improvement and to the implementation of new services.

    Chapter 3 presents the ‘conceptual model for public services’, and suggests “an organising principle for designing European public services, focusing on basic services that can be aggregated to form aggregated services and help establish other European public services in the future”:

    Chapter 4 on ‘interoperability levels’ covers “the different interoperability aspects to be addressed when designing a European public service and provides a common vocabulary for discussing issues that arise”. See the figure to the right.

    Chapter 5 presents an approach “to facilitate cooperation among public administrations to provide a given European public service by introducing concepts of ‘interoperability agreements’, formalised specifications and open specifications”.

    Chapter 6 on ‘interoperability governance’ sets out “what is needed to ensure interoperability over time when delivering a European public service and to coordinate interoperability activities across administrative levels to support the establishment of European public services”.

    Key EIF observations

    EIF v1 talked a lot about open standards. EIF v2 talks about ‘open specifications’, and makes it sound almost as if they prefer consortium standards to actual de jure standards (accept FRAND or royalty-free basis in a way that allows implementation in both proprietary and open source software). Besides, “public administrations may decide to use less open specifications, if open specifications do not exist or do not meet functional interoperability needs”. This basically means that the EIF endorses that the National Interoperability Frameworks (NIFs) can adapt fluffy ‘comply or explain’ rules similar to the current Danish government policy. It is also a loop hole to standardise on certain open, or closed, platforms (“Due to functional interoperability needs you all need to use Word 2010”).

    EIF v2s principles are interesting reading, but leaves more questions than answers. As principles (“general rules and guidelines, intended to be enduring and seldom amended, that inform and support the way in which an organization sets about fulfilling its mission”, TOGAF), the EIF principles are pretty useless.

    It so happens that the EIS document has some problems showing the document properly on my three Macs. I am not very familiar with the inner workings of the PDF format, but it seems that someone in the commission should help user “hauscbe” set his/her Windowns-based Adobe Distiller 9.0 to save a less less open standards based PDF file!

    Although it is referred to a foot note and a few hints, administrations who seek a policy endorsement for running amok with “Service-Oriented Architecture” can use the EIF. The seemingly ‘innocent’ “conceptual model for public services” is, as I read it, one big endorsement of SOA and shared/common services. EIF becomes almost mysteriously vague on these issues, but EIS offers some hints:

    Interoperability Architecture

    To develop a joint vision on interoperability architecture by first defining its scope and the needs for common infrastructure services and common interface standards;

    To provide guidance on architecture domains where Member States share a common interest;

    To ensure the systematic reuse of architectural building blocks by the Commission when developing services to be used by the Member States. Here, existing infrastructure service components (EIIS)5 along with generic applications (IMI6, early alert systems, grant management, etc.) could be reused and rationalised. Additionally, a catalogue of architectural building blocks available for reuse by the Member States and the Commission could be set up with contributions from the EU and Member States.

    Unfortunately, it seems as if the folks writing the EIF didn’t get the EIS memo; we are left to guess how they see architecture in play. With v2, EIF points to four interoperability levels – legal, organisational, semantic and technical. The organisational level includes business process alignment, organisational relationships and change management. Consequently, administrations must use an architectural approach that embraces all the levels; that would of course be enterprise architecture, I would argue. Unfortunately, rather than going that direction, EIF ends up in giving vague and uncommitted recommendations in east and west.

    Others’ reactions

    I haven’t seen any, official nor non-official, mentioning of the Communication/Strategy/Framework in Denmark yet, but that doesn’t surprise me, since interoperability has been the non-word of the year here.

    Internationally, there are plenty of reactions. As when the original EIF was launched, much of the debate/commentary about EIF v2 is about open standards and open source. Below, I have collected some illustrative quotes:

    Glyn Moody: European Interoperability Framework v2 – the Great Defeat:

    EIF v2 is a victory for the powerful and well-funded lobbyists who have attacked the European Interoperability Framework from the start, just as was predicted at the time. It shows that the European Commission is still pathetically in the thrall of big foreign companies and their proxies: I can’t wait for Wikileaks or the new Brussels Leaks to provide us with the details of what exactly happened behind the scenes when EIFv2 was being drawn up.

    Trond-Arne Undheim, Oracle Director, Standards Strategy and Policy: European Interoperability Framework – a new beginning?:

    Considering the controversy, the delays, the lobbying, and the interests at stake both in the EU, in Member States and among vendors large and small, this document is pretty impressive. As with a good wine that has not yet come to full maturity, let’s say that it seems to be coming in in the 85-88/100 range, but only a more fine-grained analysis, enjoyment in good company, and ultimately, implementation, will tell.

    Mark Bohannon, Red Hat Vice President, Corporate Affairs and Global Public Policy: European Interoperability Framework Supports Open Source:

    Is the new EIF perfect? No. Due to heavy lobbying by vested proprietary technology interests, some key sections of the EIF have been made confusing (indeed, the definition of ‘open standards’ has been watered down from the 2004 version and no longer includes the requirement of being ‘royalty-free’). The definition of “open” standards or specifications remains a matter of some contention in the IT industry. An example of a more accurate definition of open standards can be found in the recently released India Standards Policy for E-Governance, which specifies that intellectual property should be licensed royalty-free and that any required specifications should be technology-neutral.

    Openforum Europe: European Interoperability Framework – a bold move to spread the benefits of open standards and interoperability:

    “EIF will help public authorities escape from the sort of technology lock-in into one single vendor that until now has been the norm across Europe,” said Openforum Europe chief executive, Graham Taylor.

    Karsten Gerloff: Assessing the new European Interoperability Framework:

    So what we have now is a strategy statement, without the level of detail that made EIFv1 such a useful document. But this strategy generally goes in the right direction, and it’s much more powerful than before, thanks to its official status.
    I’m guessing that the change we’ll see across Europe will be slow, but that it will be continuous and very broad. EIFv1 provided a rallying point for those member states and public bodies that were interested in Free Software and Open Standards. EIFv2 is a general push for everyone to use more Open Standards, even though it contains generous get-out clauses.

    What do you think?


  • Democracy and XML

    I’m in the US (Washington, Boston, Washington) from 26 Nov to 7 Dec.

    I have been invited to come over to Washington, DC, to attend a researchers and practioners meeting in the Deliberative Democracy Consortium, which will be held Thu-Sat this coming week.

    After that, I go to Boston for the XML 2007 conference.

    Pop quiz: At which of these events will there be discussions about erosion of trust? (hint)

  • Microsoft and Danish Government in New Identity Deal

    A year ago, my former collegue Søren Peter Nielsen wrote, on behalf of the Danish government, a letter to Microsoft. Seems he got a response, and I’m sure it’ll interest XMLGrrl and many others, that an announcement was made yesterday: Agreement between the National IT and Telecom Agency and Microsoft: Agreement concerning partial support of the SAML 2.0 standard.

    “The ongoing dialog between the National IT and Telecom Agency and Microsoft has resulted in an agreement on partial support of the SAML 2.0 standard in Microsoft’s forthcoming version of their federation product named Active Directory Federation Services 2”, the agency writes.

    The text agreed upon is as follows:

    “The Danish public sector has chosen SAML 2.0 as their federation standard. Microsoft products use WS-Federation and WS-Trust as the foundation of their federated identity architecture. The Danish government has agreed that the SAML 2.0 token format is sufficient to provide basic interoperability between WS-Federation and SAML 2.0 environments as a common assertion format, without loss of authentication integrity.

    To support interoperability between WS-Federation and SAML 2.0 based products Microsoft has agreed to support the SAML 2.0 token format in the future release of Active Directory Federation Services code-named Active Directory Federation Services “2”. Microsoft will provide the Danish public sector Centre of Service Oriented Infrastructure with pre-release code to help analysis and planning of solutions for integrating WS-Federation-based clients in the Danish federation, and to collect feedback on the feature implementation.

    In addition, the co-authors of WS-Federation (including Microsoft) have submitted the specification to OASIS for standardization. This step further enables interoperability between federated environments that deploy SAML 2.0-based products and those that deploy WS-Federation-based products.”

    In commenting the agreement, the agency writes: “With this agreement a possibility for inclusion of Microsoft based clients in a common public SAML 2.0 based federation has opened”, and notes:

    The integration will require the standard based login solutions to be expanded with a special integration code. The solution is therefore a pragmatic tactical integration solution, but with the above-mentioned partial SAML 2.0 support from Microsoft it is expected that the integration can be done without influencing the individual “Microsoft Active Directory Federation Service” user organizations.

    The agency notes that more iinformation on the concrete possibilities will be published as the National IT and Telecom Agency’s Centre for Service Oriented Infrastructure receives pre-release code from Microsoft that can be integration tested.
    The agency elaborates a bit more on the deal:

    It is still desired, that Microsoft support all of the SAML 2.0 standard in their products, but the above-mentioned agreement are a good first step towards more convergence among standards for transverse user management.

    The National IT and Telecom Agency also sees the filing of the WS-Federation (WS-FED) specification for standardization in OASIS as a step that can promote convergence among federation standards.

    It should be stressed that it does not mean that the WS-Federation specification is recommended equally to SAML 2.0 for common public solutions.

    When the results of the standardization with WS-Federation become available (expectedly in the end of 2008) it might be relevant to do a new assessment but for now the SAML 2.0 it is still the only standard, which is recommended as a federation standard for Danish common public solutions.

    So, there we have it.

    I want to congratulate Søren Peter on a job well done. Stand firm on SAML 2.0, the open ecosystem needs it. And thanks to Microsoft for listening to customers (but why only partial support?).

  • Something IS Rotten in the State of Denmark

    Leif Lohdal is blogging much more continuously about the Danish open standards situation than I am. Time for me to catch up.

    On 24 April, the Danish Open Source Business Association and the Danish IT Industry Association arranged a conference in Parliament, from which I reported (in Danish, like most of the following links) over at Version2. Peter Strickx made a good presentation (soundtrack) about the situation in Belgium.

    On the same day, Prosa and Version2 arranged a debate meeting about document standards. They had invited René Løhde from Microsoft Denmark and me to meet in a “battle”. I used the opportunity to make a probably too long presentation, which I symbolically called The State of the Document World, and tried to give an “Inconvenient Truth”-style presentation, but appearently contributed to critics calling the debate “toothless”. The “battle” without a fight was made available online as a webcast a few days ago. I’ve now uploaded my presentation in PDF (1,8MB) or higher quality (7,3MB) ODP. I humbly reject to calling my message toothless! Not to say it couldn’t be presented better, of course.

    But wait, there’s more. A lot is happening, really. As a measure of “things happening” in the document format field, Version2 has published 12 articles mentioning ODF/OpenXML since the conference and battle.

    The theme is: Should government mandate one or two standards? The choices are the ODF-alone strategy or the dual-strategy with ODF and/or OpenXML.

    Yesterday morning, the involved parliamentarians and the minister met in a closed meeting. Less than a day before that meeting, the minister had released 2 reports to the parliamentarians and publically in a three (!) days long hearing. The reports, in Danish only, examine the economic consequences of mandating standards in various areas; one report dedicated to the consequences of choosing ODF. It’ll cost 180 million kroner. Yeah, right. The reports are made by Rambøll Management (yes, them, see also their explaning the appearent shift in findings).

    Helge Sander, the minister, said after the meeting that a decision is near. The parliamentarians follow the situation close, and Sander will before the summer holidays arrange for them to meet some experts, he said. Whether or not a decision will be made by him before is uncertain. He surely could, if he would – he’s the minister! I assume the parliamentarians will ride him whatever he does.

    In conclusion: Decisive indecision rules over Denmark.

  • Hiser in Danish, and now in English

    I wrote a Danish article in Version2 published yesterday. Here is my translation:

    Danish Document Controversy Raises International Concerns

    OpenDocument Foudation is very concerned about the development in Denmark. Moreover, the organisation is readying a plugin that will make it even easier to use the ODF-format.

    John Gøtze

    The awareness of the political initiatives around the usage of open standards reaches beyond Denmark.

    “Denmark needs a winning attitude, but this policy is appeasement”, comments Sam Hiser, Director of Business Affairs in OpenDocument Foundation, an organization promoting and supporting ODF.

    Sam Hiser is following the international development around ODF closely, and is not pleased with what he hears from Denmark.

    “Denmark’s dual format policy is one of the more depressing events in recent months”, he says.

    “It sets a precedent for compromise that paints Danish agencies into a corner,” he argues.

    Hiser proposes that the Danish policy should above all permit CIOs to do the necessary business process re-engineering to get away from the control of tMicrosoft.

    “We’ve always thought our conception of an ODF Plugin for MS Office as being among Microsoft’s worst nightmares. And that it is. Something which goes into Windows XP/Office and permits native file open, edits and save as ODF is going to be very interesting”, Hiser tells about the ODF Foundation’s plugin.

    There are other ODF-plugins to Microsoft Office. First, Sun’s Plugin for MS Office, which produces an OpenOffice-equivalent conversion to ODF. Second, the Microsoft/Clever Age/Novell Plugin for Office 2007.

    The OpenDocument Foundation calls their ODF Plugin for Microsoft Office “da Vinci”, but is not yet an finished product.

    Hiser explains that the da Vinci plugin has two elements the others do not. First, it has a ODF InfoSet API for server-side integration with the ODF Plugin for MS Office. Second, it has a ODF Feature-Set Wizard to help organizations govern the features in their office files.

    Hiser explains that the OpenDocument Foundation’s plugin will ensure vendor independence when developing applications that use the document data.

    Thanks, Sam!

  • Get the ODF Monograph

    UPGRADE, the European Journal for the Informatics Professional, has just published an Open Document Format Monograph.
    The monograph is published on behalf of CEPIS by Novática (ATI, Spain), in English and in Spanish. The English version is available online: download as PDF, see content and summaries. The Spanish version is out in print and soon online.

    I warmly recommend the monograph’s articles. I’m of course pleased about my contribution (announced earlier), but recommend reading several of the others first.

    These are the articles:

    OpenDocument Standard for Digital Documents
    Jesús Tramullas-Saz and Piedad Garrido-Picazo, Guest Editors

    Open by Design: The OpenDocument Format Standard for Office Applications
    Erwin Tenhumberg, Donald Harbison, and Rob Weir

    Is OpenDocument an Open Standard? Yes!
    David A. Wheeler

    OpenDocument Hidden Traps and their Side Effects on Free/Open Source Software
    Marco Fioretti

    ISO-26300 (OpenDocument) vs. MS-Office Open XML
    Alberto Barrionuevo-García

    Interoperability: Will the Real Universal File Format please Stand Up?
    Sam Hiser and Gary Edwards

    ODF: The Emerging Document Format of Choice for Governments
    Marino Marcich

    Promotion of the Use of Open Document Formats by the IDA and IDABC Programmes
    Miguel A. Amutio-Gómez

    A Brief History of Open Standards in Denmark
    John Gøtze

    Standard Open Formats and Libre Software in the Extremadura Public Administration
    Luis Millán-Vázquez de Miguel

  • ISO confirms

    In a statement to me (on behalf of Danish Version2), ISO’s Manager of Communication Services, Roger Frost, has cordially confirmed Computerworld’s story. Not that I doubted Computerworld’s Eric Lai, but I just wanted to make sure.

    Frost writes:

    ISO and IEC are to issue ISO/IEC DIS 29500 (ECMA-376) “Office Open XML File Formats” in the near future for a five-month fast-track ballot by the participating members of the ISO/IEC joint technology committee ISO/IEC JTC 1, Information technology, and by all member bodies of ISO and IEC.

    Interestingly, Frost also notes:

    At the same time, comments made by JTC 1 member bodies on the document during the 30-day review prior to acceptance for fast-tracking processing, along with the response to these comments from the fast-track proposal submitter, Ecma International, will be made available to the JTC 1 members and ISO and IEC member bodies. The national body comments and Ecma’s response are not available from ISO or IEC or JTC 1. It is up to the individual organizations whether they wish to release their comments or response.

    In the interest of an open process (hey, we’re talking about open standards here!), I hope all national bodies will publish their responses. Some have “leaked” already of course, but it would be good for the process to show a bit much more openness.

    I talked to the chairman of the Danish subcommitte, professor Mogens Kühn Pedersen from Copenhagen Business School today, and he told me that the Danish subcommittee will meet on Tuesday next week. I have suggested to Mogens that he asks the committee for permission to publish the Danish response.

  • Mandatory Open Standards in Denmark

    I’d be interested in the international reactions to this piece of news:

    On Friday, the Danish Minister of Science, Technology and Innovation, Helge Sander, made a press announcement (Danish) about his plan for following up on the Parliament Resolution 8 months ago.

    The implementation plan is presented in a report which suggests that “open standards should be implemented gradually by making it mandatory for the public sector to use a number of open standards when this becomes technically feasible”.

    The report identifies an initial sets of open standards as candidates for mandatory use from 1 January 2008 “if an economic impact assessment shows that this will not involve additional costs to the public sector”.

    The implementation plan’s elements are as follows:

    • “From 1 January 2008, all new public IT solutions should make use of the mandatory open standards relevant to the IT solution in question unless there are significant reasons for not complying with these standards.
    • If there are significant reasons for not complying with the relevant mandatory open standards, this must be reported on signing the contract, stating the reasons for applying the exceptional provisions.
    • In case of IT solutions where the technical procurement is above the EU tendering limit, the reasons must be reported to the National IT and Telecom Agency for the purpose of publication.
    • All ministers must ensure that mandatory standards are drawn up within their respective areas of responsibility where this is relevant. This must be made in cooperation with local/regional administrations in line with the existing common public projects in the area of digitalization.”

    In short: The Danish Interoperability Framework gets a new level of status: Mandatory.

    The proposed mandatory standards from 1 January 2008 falls within the following areas:

    • Standards for data interchange between public authorities
    • Standards for electronic file and document handling
    • Standards for exchanging documents between public authorities (Open Document Format and Office OpenXML)
    • Standards for electronic procurement in the public sector
    • Standards for digital signatures
    • Standards for public websites / homepages
    • Standards for IT security (only within the public sector)

    Around a dozen standards: Compliant XHTML or HTML, complaint CSS, WAI Level 2, OCES (digital signature), XML 1.0, XML Schema 1.0, NDR 3.0, FESD (docuument management), OIOUBL, UNSPSC, and DS484 (ISO 17799).

    With regard to standards for exchanging documents between public authorities, the report proposes that “it should be mandatory to use at least one of the document standards Open Document Format or Office OpenXML”, and that it is up to the individual agency to decide what they want. The report explains that a study will be conducted this year with “the purpose of obtaining the necessary experience with these standards before 1 January 2008”.

    A revised governance model should ensure more mandatory standards over time. The minister is given more authority, but not much actual power to rule over the sectors. The report goes into the “comply or explain”-principle and how it will be practised, and here, it discusses exceptions … I’ll quote in length from their English summary:

    “Requirements regarding the use of mandatory open standards will not involve any obligation or incentive to expedite procurement, upgrading or implementation of new or existing IT solutions by public authorities.

    To ensure the value of open standards to the individual authority, it is important to avoid the authority being compelled to make inappropriate choices. For this reason, a number of exceptions are made to the general rule of using mandatory open standards.

    In connection with contracts and development projects, authorities are exempted from the rules of using mandatory open standards if this means that the authority is compelled to adopt a solution which:

    • is significantly more expensive in relation to using other standards,
    • degrades the security level critically in relation to using other standards,
    • involves a significant reduction in functional performance which is a direct result of the solution being based on mandatory open standards,
    • increases the implementation time markedly,
    • leads to conflicts with standards applicable within specific areas as a result of international commitments.

    Furthermore, public authorities are exempted from the rules of using mandatory open standards if the solution does not involve data interchange with other systems.

    In case one or more of the points above are in evidence, the relevant authority may choose to dispense with specific mandatory open standards for the solution concerned.

    New solutions where technical procurement involves overall costs exceeding the EU tendering limit must be reported to the National IT and Telecom Agency on signing the contract, stating the reasons for applying the exceptional provisions.

    New solutions with overall costs below this limit should also make use of mandatory open standards, unless they fall within the exceptional provisions. However, these solutions are not subject to the reporting requirement.

    Download the English summary as PDF or ODF. The full report in Danish is here.

    The consultation period ends 23 March.

  • On the radio: Sutor, Munk and Gøtze

    During Bob Sutor’s visit in Copenhagen (I posted the homemade video with Bob Sutor the other day), I had organised for him to be interviewed by DR (Danish Broadcasting Corporation, national public radio).

    Tonight, DR brought the interview with Bob in their program Harddisken (third section), with an almost half-hour long theme about open standards hosted by Henrik Føhns. He had invited me in the studio for comments and debate with Marie Munk, Deputy Director General in the National IT and Telecom Agency. Bob apprears in edited and partly-translated form, but Marie and I were live on the air (and didn’t get to hear Bob!). So, it was there and then. Afterwards, of course – oh, why didn’t I say this and that, and all that, but it was also fun being live.
    The whole show is now downloadable as a podcast — the Harddisken podcast-feed should reach 10.000 users, I was told, and is the third most used podcast of all in DR. Go get the podcast and help Harddisken become the most downloaded podcast! (of course, it’s in Danish, but the music is great 😉 – and Bob does get a bit of airtime, which of course is in English). About two-thirds into the MP3-file.

    Since I cannot get DRs online radio and their fancy DRPlayer to work in my system (Mac OSX, Firefox) I chose not to link to those services here … but want to say to DR: Thank you for the podcasts!

  • Sutor YouTubed

    Bob Sutor gave an excellent presentation on Wednesday at the IT University of Copenhagen. In the middle of his talk, it occured to me that my TyTN gadget has a video camera, so here’s 7.38 minutes with Bob, where he’s talking about why open standards are important:

    Then memory ran out. I managed to delete some stuff, and grabbed another 4.38 minutes with this clip where Bob talks about open source and innovation.

    Update: More video from the talk in Peter Toft’s blog.