THEMES

DATABASES

DATABASES

INTRODUCTION

Underpinning modelling and analysis, data is a vital resource, and easy, efficient and secure access is essential for all modelling purposes. Developing a database which enables this, while ensuring data providers are confident in the data management and security protocols in place requires complex solutions.

Using emerging technologies, a federated databases is employed allowing data to be stored across multiple databases, yet remain accessable, facilitating different types of databases (relational, graph, array) with varying storage methods to be used for improve data and access efficiency, while also enabling methods of ensuring access requirements for datasets can be implemented with more ease.

Through the provision of an API (Application Programming Interface) access to the data is enabled for modellers and others developing code based applications with data returned in JSON/GeoJSON allowing data to be injested straigt from the API into models and for analysis, improving the potential scalability of the developed code. Data can also be returned in other formats for more easy injestion into other appliations, including as ESRI Shapefiles and GeoPackages, more suitable for software based GIS applications.

An associated web-interface allows users to view, query and download data using an easy-to-use interface. Built on the API and a GeoServer instance, this allows users to query data based on locations/boundaries, as well as on attributes, enabling use of this data resource for those wihout the need to engage in code development. Both these endpoints, the API and web-interface, utilise the developed security and metadata protocols, enabling users to only access data they have been granted permission to do so.

The data available continues to evolve as new datasets are added, new versions of existing datasests are added, and data licensing is updated opening up new data to users.

DATABASES

RESULTS

A flexible and extendable database of data for national infrastructure research with over 600 datasets stored efficiently for data management and access, utilising a range of database software and methodologies.

A application programming interface enabling secure access to data from directly within models facilitating more scaleable modelling approaches. Users are able to develop API calls through live-online documentation, and deploy within their models to retrieve available datasets required for their own models in a flexible manner which provides an easy scaleable solution. Data is made made available in a range of formats, from JSON, to ESRI shapefiles and GeoPackages. A suite of online pages also allow users to view their API call history, enabling the re-use of previous calls they have made.

User focused web-interface for easily viewing, downloading and querying data within the developed database from within a web browser. Allows users to build queries to explore data within the database, using data in the database or a user-created boundary, to filter data based on boundaries or values (attributes). Data can be viewed online and also downloaded in a range of formats, for custom maps or use in modelling.
DATABASES

APPLICATIONS

n

Multi-source access

Through the developed database, API and web-interface, users have a location whereby they can locate and access data required for their modelling and data requirements, from a range of sources.

Complex security layer

The developed database, through utilising emerging databases technologies, such as graph databases and database federation, enables fast and efficient access to key datasets, while a complex security layer ensures users can only access data they are allowed to.

National Infrastructure Database

The developed database will be deployed onto DAFNI (web link), forming a key part of the NID (National Infrasturcture Database), a national resource for infrastructure research.
DATABASES

MODELS

NISMOD-DB API

A application programming interface for access to the datasets within NISMOD-DB++ for modelling and other purposes.

NISMOD-DB Query Tool

A user interface and query buildier for viewing, querying and downloading datasets within NISMOD-DB++.

DATABASES

RESOURCES

NISMOD DB++ Architecture

A closer look at the Mistral Query Builder 

NISMOD DB++ explained

DATABASES

CASE STUDIES

Building a new future for infrastructure with ITRC

Building a new future for infrastructure with ITRC

Until recently planning infrastructure projects in a joined up way was not possible due to the size of the datasets and number of data providers involved. Infrastructure is at the heart of the UK read more

RESEARCH THEMES

ENERGY
TRANSPORT
WATER
DIGITAL COMMUNICATIONS
DEMOGRAPHICS
URBAN DEVELOPMENT
ECONOMICS
INFRASTRUCTURE
GOVERNANCE
NISMOD
RISK AND
RESILIENCE
RESEARCH SOFTWARE ENGINEERING
DATABASES