XML

Introduction

This article provides a short and rather non-technical overview of XML. See also the XML category for all XML-related topics (many) or follow up links in this overview.

Learning goals

• Understand the role of XML in IT
• Be able to identify major roles and XML languages made for the Web

Prerequisites

• none

Next steps

• Tour de XML or equivalent (having seen some real world applications would be good for motivation)
• XML principles
• Editing XML tutorial
• DTD tutorial
• XML Schema tutorial - Basics

Definition of XML

• XML means "Extended markup language". XML is a formalism that allows to define all sorts of languages that describe a wide range of "information contents" (e.g. web pages, vector graphics, programming languages). In technical terms, such languages are called XML applications or XML vocabularies.

• XML is designed as a machine readable self describing text editable persistent store for data, but it can be read (somewhat) by humans. XML is a formalism or a meta-language. Such a metalanguage is not to be confounded with HTML, a language to describe the structure of Web pages. XHTML, for example, is one out of the thousands existing XML applications.

See also: Editing XML tutorial

History

• XML is a subset of the Standardized Generalized Markup Language (SGML). SGML has been used to define HTML, whereas XHTML is defined with XML (This is why empty tags are not allowed anymore in XHTML). HTML5 on the other hand, is neither based on SMGL nor on XML.

• XML was formally defined in 1998 as W3C's XML Recommendation 1.0

• Since then, hundreds of XML languages have been defined and a few dozen are popular and in production. Ken Sall's famous Big Picture only lists some, e.g. none of the many IMS e-learning standards are mentioned.

XML and web standards

Currently, there are hundreds of more or less popular XML languages. Within the more narrow area of web standards there are less and we shall shortly introduce the most important ones that non-programmers like content developers or web designers should know about

XML for richer Web contents

Initially, XML was thought to redefine the way contents are delivered. After that, it turned out that XHTML was (almost) never used as XML, e.g. in the form HTML combined with other XML contents. This "XML" vision of HTML still exists in the mind of some people, but the death of XHTML 2 put a provisional end to this. The current mainstream, represented by HTML5, is a computer application-centered model, i.e. HTML is seen as a delivery platform for interactive contents and not as a document format.

The picture below shows the idea that web documents could be composed of several components: In the case of HTML, there is HTML + CSS, in the case of HTML5 there is HTML + built-in SVG and MATHML + plus CSS. In the case of XHTML 1 or XHTML 5 a document can include any other XML language, provided that these are identified by so-called namespaces. Although it is not longer popular, we also included SGML in the picture, since it is the "mother" of all tag-based markup languages.

HTML vs. XML Web contents ... made many years ago (DKS)

Just to make sure: The death of XHTML does by no means mean that XML is not being used on the Internet. It's just dead as web page format. Other formats like SVG (vector graphics), MathML (mathematical formula), RSS (content syndication) are very much in use today and will be so in the future.

XML as the foundation for the future semantic Web

The semantic web is essentially defined by the RDF framework. While RDF itself is used in some areas (e.g. Metadata formalisms), the global semantic web project seems to be somewhat stalled, except for occasional flares. Web 2.0 was supposed to be semantic but web 2.0 became all the opposite, i.e. it is based on simple micro-formats. Then it became web 3. Then the anti-semantic HTML 5 initiative became dominant and the "semantic web" remains a "smaller island" of interest and applications.

• Topic Maps (ISO standard) used to organize collections of resources in the form of semantic network (so you do not find just the trees, but there is a "map" of the forest.
• RDF is a language used for describing relationships between objects and it can be used for adding "metadata" describing the content of a resource.

• OWL ("Web Ontology Language", created with RDF), is a formalism that allows the description of the relationships between things. There is a conceptual link with Syndication of news and the social web

• During the last 15 years internet has been the subject of a profound change regarding the organization of its "information spaces".

XML for machine to machine talk

The exist several protocols for machine-to-machine interaction like SOAP and XML-RPC. See the web service article for more details.

In addition we can identify:

• Specialized search engines that extract contents from various XML documents;
• Formats like RSS or FOAF that are meant to help organizing networked information spaces, like content syndication;
  • RSS (in its various forms) allows automatic exchange of "titles" and "summaries" between portals and weblogs.
  • FOAF (and other formats) are used to define profiles of individuals which are then used to organize online social networks.

XML as formalism to define "grammars"

In a more general perspective, XML is currently one of the most popular standards to define various kinds of data structures. One could define three kinds:

1. XML accessories (e.g. XML Schema)
   • Extend the capabilities specified in XML
   • Intended for wide, general use
2. XML transducers (e.g. XSLT)
   • Convert XML input data into output
   • Associated with a processing model
3. XML applications in the narrow sense (e.g XHTML)
   • Define grammars, constraints for a class of XML data
   • Intended for a specific application area as diverse as for example word processors, e-learning, banking, multimedia, translation. Well know examples are Microsoft Office contents (e.g. .docx files) or Adobe Flash *.fla files. These files are in fact zip files composed of a series of XML documents. Unzip on of these and you can see.

Some technical XML concepts

An XML document can refer to a physical file, a database entry, a datastream. In other words, technically speaking an XML document is any sort of delimited "text" defined as a string and that has XML markup inside.

Wellformedness

An XML document is well formed if and only if:

There is an appropriate XML declaration at the beginning

• The document starts with an XML declaration that includes a version number (currently 1.0).

<?xml version="1.0"?>

This declaration can also contain encoding information. By default encoding isUTF-8):

 <?xml version="1.0" encoding="UTF-8"?>

XML documents are hierarchical, i.e. each element must be inside an other one (except the first one, the so-called root tag).

• begin-tags and end-tags that match
• No tags crossing like

<i>...<b>...</i> .... </b>

• There must be single root
  • It can only appear once and can not be used within other elements

Other features

• XML is case sensitive, "LI" is not "li" for example
• "Empty" tags must be self closing, e.g.

<br />

• Attribute values are quoted

 <a href="http://tecfa.unige.ch:8080/xml.html">

• Special caracters: <, &, >," and '. Use instead (and that include URLs !):

& & & &aquot; '

Valid

An XML document is said valid if it conforms to some kind of grammar also called schema. An XML grammar formally describes an XML application (or vocabulary or language).

The most popular ones are in this order:

• DTDs (Document Type Definitions)
• XML Schema
• Relax NG

XML applications in addition to DTDs may include other constraints. Some XML applications may include languages that are not XML-based (e.g. CSS or XPath).

The most popular grammars are DTDs. Below we just include a picture of a little grammar (read the details in DTD tutorial

Simple DTD

Text-centric vs. data-centric XML

Data-centric XML as opposed to the text-centric XML refers to XML whose primary audience is not a human reader, but a computer program which will process the information, respond to it, store data items in a database, and so on.

A list of XML applications

See also Tour de XML, a selection of links demonstrating various uses of XML.

Accessories

Extend the power of XML

• XLink: Hypertext links
  • http://www.w3.org/TR/xlink/

• XPointer (ressource pointers)
  • http://www.w3.org/TR/xptr/

• XPath (XML fragments identification)
  • http://www.w3.org/TR/xpath
  • (used by XSLT, XInclude, XLink, XQuery, XPointer etc.)
  • See the XPath tutorial - basics

Transducers

Various style sheet and query languages

• XSL/FO (application XML): XML Style language
  • http://www.w3.org/TR/xsl/

• XSLT(application XML): XML Transformation language
  • http://www.w3.org/TR/xslt
  • See the XSLT Tutorial - Basics

• XQuery: XML Query Language
  • http://www.w3.org/TR/xquery/
  • See the XQuery tutorial - basics

Metadata and semantic web

• RDF applications (a whole lot of languages for the semantic web)
  • See http://www.w3.org/RDF/

• PICS 2.0: Platform for Internet Content Selection
  • http://www.w3.org/PICS/

• P3P: Platform for Privacy Preferences
  • http://www.w3.org/P3P/

Graphics and multimedia

• SMIL: Synchronized Multimedia Integration Language
  • http://www.w3.org/AudioVideo/

• SVG: Scalable Vector Graphics
  • http://www.w3.org/TR/SVG/

• MathML: Mathematical Markup Language
  • http://www.w3.org/Math/

Contents

• XHTML: this now less popular variant of HTML is an XML application
  • http://www.w3.org/TR/html/

• Docbook: the Most popular standard for writing large documents.

• DITA. A more flexible module-based approach to documents, originally made by IBM.

• ePub, a popular open e-book standard.

These document standards (as well others) can intervene all stages of the document production/delivery pipeline. XML in the documentation world appears as:

Application development

• MXML is an XML-based user interface markup language used in Adobe Flex, a software development kit to create Flash-based Internet and desk-top applications.
• XML User Interface Language (XUL) is the XML user interface markup language developed by the Mozilla project. It operates in cross-platform applications such as Firefox.

XML and documentation languages

Any XML document can directly be put on the web together with a CSS stylesheet or an XSLT transformation. Specialized formats like SVG (vector graphics), X3D (3d vector graphics), MathML (formulas) can be added to XML-compatible browsers. Larger documents are often produces with specialized vocabularies such as DITA or DocBook. Contents can be written either with an XML editor or an XML-aware word processor. Such documents can then be either directly "saved as" or sent through various cusom output filters.

XML document production pipelines

Presenting XML documents with style sheets

Today one can directly display information encoded in XML (of any grammar) in a browser, by using a style-sheet. The style-sheets allow to:

• Prepare / arrange content for a "presentation".
• Define the “layout” (format, formatting) of a text written in Xml.
• Alter contents, e.g. by adding a table of contents or page headers

The utility of style-sheets is therefore

• Separation of content and presentation
• Simplification of work (one style-sheet for many documents, single source publishing, etc.)

XSL - The Extensible Stylesheet Language

XSL refers to two languages recommended by W3C

• http://www.w3.org/TR/xsl

XSL either refers to XSLT or XSL/FO and they provide two principal functions:

(1) XSLT is a transformation language for Xml elements.

For example: XSLT allow for the creation of table of contents or the translation XML to HTML

• http://www.w3.org/TR/xslt

(2) XSL/FO is formatting language that allow to create high quality print documents

• http://www.w3.org/TR/xsl/

Formatting with XSL-FO

• sophisticated formatting, also by inheritance, position etc..
• generation of text and graphics
• possibility to define macros
• everything that can be found in CSS, and more…

CSS(Cascading Style Sheets)

CSS also can be used for style XML contents. However since its transformation capabilities are rather poor, the XML already should include all the data to be published.

• XML support is included since CSS2.

XLink - Towards a better hypertext?

Xlink allows inserting a link in XML document, where a link expresses a relationship between two or more objects. XLink remains a proposal, there’s no complete implementation for the moment. However, subsets of Xlink are used in various other XML languages.

• a subset is used in SVG, X3D etc..
• http://www.w3.org/TR/xlink

XLink is based on other standards (and that are also shared with XSLT)

• XPointer = how to identify an XML fragment (used by links). XPointer is based on Xpath
• XPath = how to identify a path towards a resource

• http://www.w3.org/TR/xptr
• http://www.w3.org/TR/xpath

Principal characteristics of XLink

• Multi-directional links, links towards multiple destinations
• Occlusions, inclusions, content replacements in a document

Where does this standard come from?

• HTML

• Anchors: href (attribute A), src (attribute of IMG and NOTE) ...
• Targets: name attributes (A), id (attribute in HTML 4.x)

• mainly: SGML HyTime and TEI Extended Pointers (extension to HyTime) languages.

XML in education

On has to make a distinction between languages specifically developped for the education section (see below) and all the rest of XML technology, most of which can be useful to education

• See the various Educational modeling languages, in particular the ones produced by IMS

• Content packaging and storage, e.g.
  • IMS Content Packaging
  • Learning Object Metadata Standard

• In addition, there are languages for selling education, to exchange student data, curricula data etc.

XML Software

(longer entries have their own page)

XML creation

• See XML editor

XML databases

• See XML database

Validation

Off-line validation

• Most decent XML editors do offer validation functionality. However, some free XML editors do not. Some (like Xemacs) only offer limited verification.

• xmllint, a command line tool which is distributed as part of the libxml2 C parser developed for the Gnome project. This means that it ships with most Linux installations, but there also distributions for Windows and other OSs.
• You can find several tools on source forge

On-line validation

Note: You may need to change DTD's or Schema's local system identifier. These programs must be able to get the DTD. I rather suggest installing a local program on your machine (like xmllint or xmlTester).

• STG XML Validation Form, curtosy of Scholarly Technology Group, Brown University
• XML well-formedness checker and validator, Richard Tobin, University of Endinburgh (RXP parser)
• XML.com's (simple well-formedness)

On-line validation for specific XML applications

• W3C HTML Validation Service This validator doesn't work with your own DTD's. Its primary function is to validate W3C vocabularies (HTML, XHTML, SVG, MathML, ... )

• FEED Validator. Validates various RSS Formats plus PIE

Online tools

Some websites offer functionality to perform simple xml tasks like formatting, diffing, transforming, validating, querying XML.

Website	Features
http://www.shancarter.com/data_converter/	Conversion from Excel and csv to XML
http://www.shell-tools.net/index.php?op=xml_format	Format and validation (dtd and xsd)
http://tools.decisionsoft.com/xmldiff.html	Diff (compare XML files)
http://tools.decisionsoft.com/schemaValidate/	Validation (XSD)
http://chris.photobooks.com/xml/	Format, transformation (XSLT) and query (Xpath)
http://www.xmltools.dk/	Query (Xpath)
http://xslt.online-toolz.com/tools/xslt-transformation.php	Format, transformation (XSLT) and Validation (XSD)
http://www.w3schools.com/xsl/tryxslt.asp?xmlfile=cdcatalog&xsltfile=cdcatalog	Transformation (XSLT)
http://www.qutoric.com/xslt/analyser/xpathtool.html	Query (Xpath)

Links

Overviews

• XML in 10 points (W3C, 2001)
• XML Family of Languages, Overview and Classification of W3C Specifications, by Airi Salminen, 07 September 2012

Tutorials

(this sections needs to be expanded some day)

• See XML-related entries in this wiki. There are some tutorials.
• whitepaper on structured authoring, by Sarah O’Keefe.
• XML:Managing Data Exchange. Thi Wikibook project introduced XML from a Data exchange perspective.

News

• Cafe con Leche XML News and Resources (Best resource to keep in touch with XML-related news)

Lists of XML applications (schemas)

• XML Standards Library by Liquid technologies. Good list, indexed by category. Added 15:54, 28 July 2010 (UTC).
• List of XML markup languages Good list, but as of 17:11, 9 June 2010 (UTC) by no means complete, e.g. most e-learning standards are missing.
• OASIS (an XML standardization organization) publishes Coverpages (newsletter and XML resource). It includes XML Applications and Initiatives (an ugly unsorted but interesting list).
• XML.gov is a US government web site that coordinates XML initiatives. Helps to find various standards they are interested in, e.g. a list of efforts.

References

• Elliotte Rusty Harold, (2004). XML in a Nutshell, O'Reilly, Abstract/TOC ISBN 0-596-00764-7 (Best buy according to DSchneider).