Jump to content

Open data in the United Kingdom

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by EricITOworld (talk | contribs) at 13:02, 12 January 2011 (Transport Direct: some details added here). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

There have been campagins in the UK for its government to open up the large amounts of data it has for greater public usage without prohibitivly large fees.

History

In March 2006 The Guardian newspaper's Technology section began a "Free Our Data" campaign, calling for the raw data gathered by Ordnance Survey (not to mention data gathered on its behalf by local authorities at public expense) to be made freely available for reuse by individuals and companies, as happens, for example, with such data in the USA. However, Ordnance Survey claims that the quality of the freely available government mapping in the USA is low or variable because of funding issues.[1]

On the 7 April 2006 the Office of Public Sector Information (OPSI) received a complaint from the data management company Intelligent Addressing.[2] Many, although not all, complaints were upheld by the OPSI, one of the conclusions being that Ordnance Survey "is offering licence terms which unnecessarily restrict competition". Negotiations between Ordnance Survey and interested parties are ongoing with regard to the issues raised by the OPSI report, Ordnance Survey being under no obligation to comply with the report's recommendations.

In June 2006 the Free our data campaign run by The Guardian said "In an age when it is not seen as appropriate for the public sector to run power stations or railways, why is it running nationalised industries in what should be the most dynamic sector of all, the web-based knowledge economy? The question lies at the heart of our campaign, which argues that government’s role should be to collect and administer high-quality raw data, but make it freely available to everyone to create innovative services". Transport Direct's chief executive, Nick Ilsley, said that research by the department prior to Transport Direct’s launch had showed the private sector wasn’t interested in providing a one-stop all-purpose site.[3]

In April 2007, Cabinet Office Minister Hilary Armstrong commissioned Ed Mayo and MySociety director Tom Steinberg to draft a "Power of Information Review" on how the government could serve the public's information needs better.[4] The resulting report led Cabinet Minister Tom Watson, MP to create a 'Power of Information Task Force.[5]

Since August 2007, Ordnance Survey has contracted the political lobbying company Mandate Communications[6] to help campaign against the free data movement and discover which politicians and advisers continue to support their current policies.[7] In 2008 MySociety requested to OPSI that the dataset should be made available for re-use as Open Data rather than at a charge of £7,500.[8]

In April 2008 Tom Watson MP, Parliamentary Secretary at the Cabinet Office said that pledged to turn upside down the British public's "recipient relationship" with official information.[9]

The 'Power of Information Taskforce Report' was published by the Cabinet Office in February 2009.[10] It reported that although the National Public Transport Data Repository, described itself as ‘Crown Copyright’ investigations showed this database is not actually government data and that the NPTDR charges significant fees for use. The report suggested that there should be a presumption in favour of information which has been created by public sector bodies being available for re-use. They also suggested that there should be a clear and consistent copyright and licensing rules applied making it easy to work with data from multiple sources in the public sector. They recommended a 'Crown Commons' style approach with "highly permissive licensing scheme that is transparent, easy to understand and easy to use, modeled on the 'Click Use' license".[11]

Also in February 2009 Tom Watson MP from the Cabinet Office advised that the UK government would put Open-source software on equal footing for procurement; stating that "Procurement decisions will be made on the basis on the best value for money solution to the business requirement, taking account of total lifetime cost of ownership of the solution, including exit and transition costs, after ensuring that solutions fulfil minimum and essential capability, security, scalability, transferability, support and manageability requirements." and "Where there is no significant overall cost difference between open and non-open source products, open source will be selected on the basis of its additional inherent flexibility".[12]

In August 2009 Tom Watson MP mused on his website under the title "Wacky terms and conditions" about why the DirectGov version of the transport direct portal included this condition: “you may retrieve and display Content from the Website on an electronic visual display device, print individual pages on paper (but not photocopy them)”.[13]

In September 2009 Sir Tim Berners Lee and Professor Nigel Shadbolt who had been appointed by Gordon Brown to advise the Government on how to make data more accessible to the public were invited to Number 10 Downing Street to present their early findings to the cabinet.[14]

In October 2009 Tom Watson MP questioned why railway timetables were the train operators' private intellectual property. He asked Junior transport minister Chris Mole: "Does not my hon. Friend think that the timetable data belong to the people, and that we should make them available for free?".[15] He also proposed an Early Day Motion that read "That this House calls on the Government to ensure that transport timetables for rail and bus operators are made freely available for re-use, using an open standards format, thus enabling voluntary and commercial organisations to publish the data on their own digital platforms". It was signed by 32 MPs.[16]

In November 2009 the then Prime Minister, Gordon Brown announced that "mid-scale" data from Ordnance Survey would be made available for free reuse, including commercial applications,[17] [18] from April 2010. A consultation was held inviting responses between 23 December and 17 March by the Department of Communities and Local Government.

In December 2009 Local Transport Today reported that 'Data release could spark transport IT innovations". The magazine reported that "Among the data to be made accessible through the site are trunk road traffic volumes, the National Public Transport Access Node (NaPTAN) database and the National Public Transport Data Repository (NPTDR)". A DfT spokeswoman was reported to say: “We will seek to embrace new technology to enable partners to provide exciting, user-focused services such as recently seen with satellite navigation and i-phone applications,”[19]

In January 2010 a new government web-service, data.gov.uk was unveiled which would "offer reams of public sector data, ranging from traffic statistics to crime figures, for private or commercial use". The aim of the project was to "kickstart a new wave of services that find novel ways to make use of the information".[20] The US had recently launched data.gov[21] and London Mayor Boris Johnson had created the London Data Store the same month.[22]

In March 2010 the Prime Minister Gordon Brown announced that the NaPTAN dataset was to be immediately made available from the data.gov.uk site as Open Data, as well as confirming an impending release of Ordnance Survey data. In his speech he observed that at present public transport timetables and real-time running information was owned by the operating companies but that the government would work to free it up. He also said that "from today we will make it a condition of future franchises that this data will be made freely available".[23]

Also in March 2010 a Freedom of Information request was made to the Department for Transport inquiring about arrangements that had been made for the release of cycling data that was being collected for the portal at public expense. It requested information about any claims the Ordnance Survey would have over the data and if so the terms, and prices charged for making the data available to Ordnance Survey customers. Also the cost to a Local Authority for adding their area to the planner and for notes of any meetings of project boards and working parties.[24] A response was published on 1 April 2010.[25]

On 1 April 2010 Ordnance Survey released[26] the brand OS OpenData, under an attribution-only license compatible with CC-by.[27] Various groups and individuals had campaigned for this release of data, but some were disappointed when the some of the profitable datasets were not included - withheld for the counter-argument that if licensees don't pay for OS data collection then the government would have to be willing to foot a £30m p.a. bill, to obtain the future economic benefit of sharing the highly detailed mapping produced by the UK's national agency.[28] The files have been cached on the MySociety website for convenient download.[29] They can also be found on the OS website alongside their commerical data. [30]

Data Holders

Transport Direct

Transport Direct is a division of the UK Department for Transport to develop better information technology systems to support public transport. It has created a comprehensive database of all public transport movements in the United Kingdom and has developed and operates the Transport Direct Portal. Since the launch of the Portal in December 2004 there have been growing calls for the public transport schedule data, which is generally owned by the transport operator, to be made available as Open data.

The development of Transport Direct has created a number of comprehensive national datasets to support the Transport Direct Portal. The assessment of accessibility to services by public transport was made a requirement for the Local Transport Plans in 2004. Measuring the level of accessibility required the use of the data collected by Transport Direct.[31]

This data is being used by an increasing number of 3rd parties, including Google Transit (South East Traveline Region)[32] and East Anglia / East Midlands Traveline Regions.[33] MySociety's 'Mapumental' accessibility product.[34] During 2010 increasing amounts of data has become available as Open Data including NaPTAN and NPTDR.

Ordnance Survey

Ordnance Survey has been subject to criticisms. Most criticism centres on the point that Ordnance Survey possesses a virtual government monopoly on geographic data in the UK,[35] while, although a government agency, since 1999 it has been required to act as a Trading Fund or commercial entity. This means that it is supposed to be totally self-funding from the commercial sale of its data and derived products - whilst at the same time it is supposed to be the public supplier of geographical information. In 1985 the "Committee of Enquiry into the Handling of Geographic Information" was set up in to “advise the Secretary of State for the Environment within two years on the future handling of geographic information in the UK, taking account of modern developments in information technology and market needs”. The Committee's final report was published under the name of its chairman, Roger Chorley, in 1987.[36] The report stressed the importance of widely available geographic information to the UK and recommended a loosening of government policies on distribution and cost recovery.

Ordnance Survey historical works are generally available, as the agency is covered by Crown Copyright: works more than fifty years old, including historic surveys of Britain and Ireland and much of the New Popular Edition, are in the public domain. However, finding suitable originals remains an issue as Ordnance Survey does not provide historical mapping on 'free' terms, instead marketing commercially 'enhanced' reproductions in partnership with Landmark. This can be contrasted with, for example, the approach in the Republic of Ireland in more recent times, where Ordnance Survey Ireland claims regular copyright over its mapping (and over digital copies of the public domain historical mapping).

References

  1. ^ "Free Our Data: Articles: the Ordnance Survey official response". The Guardian. Retrieved 2008-08-20.
  2. ^ OPSI
  3. ^ "Why is the government trying to corner the market for travel-direction sites?". Free our data. Retrieved 2010-03-27.
  4. ^ "The Power of Information Review: online advice sites could improve citizen empowerment". Cabinet Office. Retrieved 2010-10-05.
  5. ^ "About the Task Force « Power of Information Task Force".
  6. ^ Greg Clark Written Questions, 1 May 2008 col. 668W Ordnance Survey: Mandate Communications
  7. ^ Cross, Michael (21 August 2008). "Ordnance Survey hires PR company to lobby politicians". The Guardian.
  8. ^ "National Public Transport Data Repository". Office of Public Sector Information. Retrieved 2010-03-27.
  9. ^ Cross, Michael (2008-04-03). "Report backs freer use of data". The Guardian. London. Retrieved 2010-03-27.
  10. ^ "http://www.cabinetoffice.gov.uk/reports/power_of_information.aspx" (PDF). Cabinet Office. Retrieved 2010-10-05. {{cite web}}: External link in |title= (help)
  11. ^ "Power of Information Taskforce Report" (PDF). Cabinet Office. p. 24. Retrieved 2010-03-27.
  12. ^ Arthur, Charles (2009-02-29). "UK government puts open source software on equal footing for procurement". The Guardian. London. Retrieved 2010-03-27. {{cite news}}: Check date values in: |date= (help)
  13. ^ "Directgov terms and conditions". Tom Watson MP. 2009-08-19. Retrieved 2010-03-27.
  14. ^ "PM welcomes Sir Tim Berners-Lee to Downing Street". Number10. Retrieved 2010-03-28.
  15. ^ "Rail Services". Hansard. 2009-10-22. Retrieved 2010-03-27.
  16. ^ "RAIL AND BUS TIMETABLES". Parliament. 2009-10-29. Retrieved 2010-03-28.
  17. ^ "Ordnance Survey to open up data - PM". 17 November 2009. {{cite news}}: Unknown parameter |[url= ignored (help)
  18. ^ "Gordon Brown announces OS maps to be free online". Free our data. 2009-11-08. Retrieved 2010-03-28.
  19. ^ "Data release could spark transport IT innovations". Local Transport Today. 2009-12-18. Retrieved 2010-03-27.
  20. ^ "One-stop shop for Government data launched". Number10. 2010-01-21. Retrieved 2010-03-28.
  21. ^ "Tim Berners-Lee unveils government data project". BBC News. 2010-01-21. Retrieved 2010-03-28.
  22. ^ "Hectic Times". London Data Store. 2010-02-15. Retrieved 2010-03-28.
  23. ^ "Speech on Building Britain's Digital Future". Number10. 2010-03-10. Retrieved 2010-03-27.
  24. ^ "Transport Direct Cycle Journey Planner". What do they know. Retrieved 2010-03-27.
  25. ^ "Transport Direct Cycle Journey Planner". WhatDoTheyKnow. {{cite web}}: Text "accessdate-2010-4-03" ignored (help)
  26. ^ "Ordnance Survey launches OS OpenData in groundbreaking national initiative". Ordnance Survey. 2010-04-01. Retrieved 2010-04-16.
  27. ^ "OpenData License Terms and Conditions" (pdf). Ordnance Survey. Retrieved 2010-04-05.
  28. ^ "The Ordnance Survey has opened up its map data for free after a long campaign. Find out what was released". The Guardian. 2010-04-02. Retrieved 2010-04-16.
  29. ^ "OS OpenData downloads". mySociety. Retrieved 2010-04-05.
  30. ^ "OS Products". Ordnance Survey. Retrieved 2011-01-12.
  31. ^ Cite error: The named reference MVA Consultancy was invoked but never defined (see the help page).
  32. ^ Cite error: The named reference Google Trip planning for Europe was invoked but never defined (see the help page).
  33. ^ Cite error: The named reference Autumn updates for Google Transit was invoked but never defined (see the help page).
  34. ^ Cite error: The named reference Say hello to Mapumental was invoked but never defined (see the help page).
  35. ^ Guardian
  36. ^ Chorley, R.R.E. (1987) Handling Geographic Information. Report of the Committee of Enquiry chaired by Lord Chorley, London: HMSO.