Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Upcoming SlideShare
Cápsula 1. estudios de mercado
Next
Download to read offline and view in fullscreen.

Share

STATVIEW: a web platform for visualisation and dissemination of statistical data and geospatial analysis

Download to read offline

STATVIEW represents a useful open source tool that can be conveniently shared among NSOs for analysing, visualising and sharing cartographic data in a machine-readable format.

  • Be the first to like this

STATVIEW: a web platform for visualisation and dissemination of statistical data and geospatial analysis

  1. 1. A WEB PLATFORM FOR THE VISUALISATION AND THE DISSEMINATION OF STATISTICAL DATA AND GEOSPATIAL ANALYSIS Alessandro Capezzuoli Emanuela Recchini ESS Visualisation Workshop Valencia, Spain, May 17-18, 2016 www.statview.eu
  2. 2. ESS Vision 2020: directions for National Statistical Offices1 3 4 5 2 Concluding remarks A tool for visualisation, dissemination and geospatial analysis: STATVIEW Data visualisation, webgis and statistical data Data dissemination formats, standards and methods A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  3. 3. 1. ESS Vision 2020: directions for National Statistical Offices The UN Fundamental Principles of Official Statistics and the European Statistics Code of Practice provide a crucial guidance in achieving the ESS Vision 2020. In fact, an essential role in supporting analysis and decision making is played first of all by statistical information that is produced under strict conditions and quality criteria for both outputs and processes. In this respect, highest quality can be found in information derived from data that are produced under the statistical programme of a given country or an international organization (Official Statistics). Introductory remarks As highlighted in the ESS Vision 2020: Official statistics have always strived to adapt to major developments in society and the economy. The ever increasing availability of data is a trend that is of strategic relevance for official statistics. There is a need to assess and interpret the meaning of these data in an intelligent and interactive fashion. 1 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  4. 4. 1. ESS Vision 2020: directions for National Statistical Offices In order to deliver ESS Vision 2020, five key areas have been identified. Their formulations are centered around a number of specific points: Key area 3 - New data sources We base our statistical products and services on both traditional surveys and newer sources, including administrative data, geospatial and, where possible, big data. New data sources complement the existing ones and help us to improve the quality of our products. Key area 4 - Efficient and robust statistical processes We will intensify our collaboration … also by sharing tools … . Key area 5 - Dissemination and communication on European statistics We recognise that different user groups have different needs and capabilities, both in terms of products and dissemination channels, and we will address this diversity by offering a variety of output channels and services. Solicited by ESS, National Statistical Offices (NSOs) have started exploring new technology- driven areas when dealing with very large amount of data and are developing suitable tools for the integration of different types of information and its dissemination, i.e. platforms for data storage, analysis and visualisation. Keywords in the ESS Vision 2020 2 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  5. 5. If you have an apple and I have an apple and we exchange these apples then you and I will still each have one apple. But if you have an idea and I have an idea and we exchange these ideas, then each of us will have two ideas. (George Bernard Shaw) If you have a single data and I have a single data and we exchange these data, then all have two data 2. Data dissemination formats, standards and methods
  6. 6. • The role of National Statistical Offices 2. Data dissemination formats, standards and methods Introductory remarks • Data dissemination and visualisation in the Internet Era • Data sharing at the basis of knowledge • Challenges: measurement, description and representation of statistical data 4 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  7. 7. 2. Data dissemination formats, standards and methods Statistics data flow 1 - Acquisition 2 - Treatment 3 - Dissemination 5 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  8. 8. W3C open standard formats: XML vs JSON 2. Data dissemination formats, standards and methods eXtensible Markup Language Javascript Object Notation JSON CAN BE USED BY: Programming languages: Frameworks for graphical and cartographic representations: • Javascript • Ajax • PHP • JSP • PYTHON • NodeJS • Openlayers • Leaflet • RaphaelJS • D3JS 6 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  9. 9. The XML format relies on the use of a Service Oriented Architecture - SOA W3C open standard formats: XML vs JSON 2. Data dissemination formats, standards and methods The JSON format relies on the use of a Resource Oriented Architecture - ROA - is not a standard, is just an architecture style for designing networked applications - is a lightweight alternative to mechanisms like RPC (Remote Procedure Calls) and Web Services (SOAP, WSDL, etc.) - is a service concept that may be summarized by the CRUD principles Representational State Transfer (REST) 7 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  10. 10. W3C open standard formats: REST vs NO REST 2. Data dissemination formats, standards and methods 8 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016 WITHOUT REST WITH REST
  11. 11. RESTful - Systems conforming to the REST constraints SOAP – Simple Objects Access Protocol REST WEBSERVICES Architectures for data visualisation 2. Data dissemination formats, standards and methods Can be used as Application Programming Interface (API) 9 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  12. 12. The Italian National Institute of Statistics (Istat) uses several channels for data dissemination: The Istat experience Data dissemination in Official statistics An example: ISTAT ACCIDENTS DATA The single exit point for exchanging and supplying data to Eurostat and other institutional subjects through the SDMX format I.STAT, a web channel allowing data downloading in several formats (csv, excel, etc.) A set of API REST to disseminate data in the JSON-STAT format 3. Data visualisation, webGIS and statistical data Istat, like other NSOs, uses the JSON-STAT format for its data dissemination 10 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  13. 13. JSON-STAT, SDMX, ODATA An example from Statistics Sweden 3. Data visualisation, webGIS and statistical data 11 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  14. 14. The Istat datawarehouse is conceived on the basis of the multi-dimensional array of data OLAP Cube (On-Line Analytical Processing). JSON-STAT, SDMX, ODATA The Istat Datawarehouse The OLAP Cube is characterized by: • Dimensions – i.e. the dimensional spreadsheets containing the descriptive attributes of the measures (Province, Region, gender, date of birth, etc.). The faces of the cube contain the dimensions, while each cell contains the value related to the intersection of dimensions. • Measures – describe the qualitative aspects of a given event. 3. Data visualisation, webGIS and statistical data 12 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  15. 15. The JSON-stat format is a simple lightweight JSON format for data dissemination. It is based on a cube model that arises from the evidence that the most common form of data dissemination is the tabular form. JSON-STAT, SDMX, ODATA The JSON-stat format In this cube model, datasets are organized in dimensions. Dimensions are organized in categories. JSON-stat has been the starting point for the development of StatVIEW 3. Data visualisation, webGIS and statistical data 13 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  16. 16. JSON-STAT, SDMX, ODATA Open data utilisation 3. Data visualisation, webGIS and statistical data • Considerable evolution of dissemination and visualisation of data from official statistics • Proliferation of tools for data visualisation and cartographic analysis (Tableau, Microstrategy, Spago BI, etc.) … nevertheless … 14 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016 The potential of georeferenced spatial data is still underutilized
  17. 17. JSON-STAT, SDMX, ODATA3. Data visualisation, webGIS and statistical data The potential of georeferenced spatial data is still underutilized
  18. 18. JSON-STAT, SDMX, ODATA WebGIS and statistical data platform ➢ Data dissemination and cartographic visualisation ➢ Dynamic territorial analysis ➢ Production of ad hoc applications for analysis and treatment of specific phenomena ➢ Data integration using REST (or SOAP) webservices and a standard for data representation (e.g. JSON-STAT), differently usable by a relational database designed on the basis of an Entity–Relationship model. ➢ Reaching a wider and more diversified audience, in as much as they satisfy numerous needs of analysis 3. Data visualisation, webGIS and statistical data 15 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  19. 19. 4. A tool for visualisation, dissemination and geospatial analysis StatVIEW is a web GIS and statistical data platform comprising: 1) Map Server and a geospatial database (Geoserver, Postgres, PostGIS) 2) Different data sources (datawarehouse, webservices, database, etc.) 3) Interrogation engine and user interface WMS WFS WCS StatVIEW: • Highly scalable system o Supports different data sources (database, files, webservices) o Supports different models for open data sources (SDMX, DDI, JSON-STAT) o Supports different formats for open data sources (XML, JSON) • Source output in JSON-stat format 16 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  20. 20. JSON-STAT, SDMX, ODATA4. A tool for visualisation, dissemination and geospatial analysis StatVIEW (www.statview.eu) allows users to carry out operations normally included in GIS Desktop and WebGIS systems: ● Buffering ● Network analysis ● Topology Overlay 17 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  21. 21. Architecture 4. A tool for visualisation, dissemination and geospatial analysis 18 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  22. 22. 4. A tool for visualisation, dissemination and geospatial analysis DENSITY MAP A density map for vehicles involved in road accidents Dimensions associated to the dataset Representation type (cartographic, graphic, table) Customize the research 19 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  23. 23. DYNAMIC GRAPH A dynamic graph for vehicles involved in road accidents 4. A tool for visualisation, dissemination and geospatial analysis 20 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  24. 24. 4. A tool for visualisation, dissemination and geospatial analysis A table for vehicles involved in road accidents realized with JSON-STAT Table Browser TABLE 21 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  25. 25. OVERLAY: Map - residence permits of non-EU citizens A tool for visualisation, dissemination and geospatial analysis By selecting the layers and, for example, a different base map, or a different color shade, or a different partition (quartile, quintile), it is possible to get a different visualisation, leading to a different interpretation of the phenomenon. The customization depends on the layers available in the chosen map. Another layer creates, via a geospatial query, a bubble chart representing the number of the georeferenced organizations active in the territory One layer contains the georeferenced organizations providing assistance to migrants 22 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  26. 26. A tool for visualisation, dissemination and geospatial analysis By using an OSRM (Open Source Routing Machine) routing algorithm, it is possible to obtain the shortest route to a geo-localised point in the map server used by StatVIEW (e.g. hospital, police station, etc.) from any point in the map, as well as the respective travel time. Routing 23 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  27. 27. 4. A tool for visualisation, dissemination and geospatial analysis The dimension of the arrows gives an idea of volumes: the thicker the arrow, the greater the flow. Changes of residence for foreign citizens to and from Italian Provinces It is possible to represent inflows and outflows to and from a given territorial border. . INTERNAL FLOW It is possible to set the maximum distance or the distance range for the desired flows. For example, we may be interested in visualizing the flows within 100 km from a given Province, or within a distance ranging 100-300 km. 24 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  28. 28. 4. A tool for visualisation, dissemination and geospatial analysis ITALIAN REGIONS This example shows the evolution of employment data at the regional level 25 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  29. 29. 4. A tool for visualisation, dissemination and geospatial analysis ITALIAN MUNICIPALITIES This example shows the Romanian citizens who are resident in the Italian Lazio Region at the municipal level 26 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  30. 30. 4. A tool for visualisation, dissemination and geospatial analysis In the example a pyramid graph showing the age of foreign citizens resident in Italy, compared to that of resident Italian citizens PYRAMID GRAPH The standardization of the sources’ output allows the creation of ad hoc plugins for the generalized visualisation of multi-source graphs or dashboards. 27 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  31. 31. 4 A tool for visualisation, dissemination and geospatial analysis AD HOC WEB APPLICATION The case of management of immigration centres provides an example of how StatVIEW, thanks to the support of geospatial database, allows users to develop ad hoc applications. The map indicates the position of immigration centres. The colours indicate the number of available accommodations (red = no accommodation available; orange = few accommodations available; green = many accommodations available). By clicking on the marker of an immigration centre, an interested user (like, for example, a Prefecture) can book a certain number of accommodations, in order to equally distribute immigrants. In a reserved area, it is possible to insert a new immigration centre (e.g. Via Diego Cadello, 9, Cagliari, Italy, Lat 39.238140, Lng 9.118743) that, thanks to the geospatial database, will be immediately visualized on the map. 28 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  32. 32. A tool for visualisation, dissemination and geospatial analysis HEATMAP 29 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016 Heatmap of private museums, monuments and archeological areas in Italy
  33. 33. A tool for visualisation, dissemination and geospatial analysis CLUSTERING 30 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016 Marker clusters of private museums, monuments and archeological areas in Italy
  34. 34. With the support of StatVIEW, it is easier for research work to analyze a specific phenomenon, overlay different layers to describe several phenomena as a whole and quickly monitor the evolution of different phenomena at the same time. 5. Concluding remarks This helps to highlight the possible connections between phenomena or the impacts that the phenomena under investigation have on each other, thus facilitating the analysis and the drafting of proper and early-warning advice for decision making. According to the ESS Vision 2020, developing an ESS that engages users proactively and meets their demands in a cost-efficient and responsive manner is one aim of the EU agenda. A web platform such as StatVIEW is along these lines. In providing high quality information, StatVIEW is time saving and cost- effective. It represents a useful open source tool that can be conveniently shared among NSOs for analyzing, visualizing and sharing statistical and cartographic data in a machine-readable format. 31 A web platform for the visualisation and the dissemination of statistical data and geospatial analysis Alessandro Capezzuoli, Emanuela Recchini – ESS Visualisation Workshop, Valencia, Spain, May 17-18, 2016
  35. 35. alessandro.capezzuoli@istat.it emanuela.recchini@istat.it THANK YOU FOR YOUR ATTENTION FOR ANY QUESTIONS CONTACT US:

STATVIEW represents a useful open source tool that can be conveniently shared among NSOs for analysing, visualising and sharing cartographic data in a machine-readable format.

Views

Total views

1,069

On Slideshare

0

From embeds

0

Number of embeds

25

Actions

Downloads

13

Shares

0

Comments

0

Likes

0

×