hpc-storage

The Memorial Bridge between Kittery, ME and Portsmouth, NH has several sensors on and below that collect data and record that data in an on-bridge database in a raw form. This project is extracting data from the on-bridge database into a new researcher-facing database that will offer publicly-available dataset extractions and on-server calculations for those researchers who wish to understand the work being done on the Living Bridge. The work in this project involves the understanding of the sensor data on the bridge, the existing schema of the database, developing a new schema for the researcher-facing database, and populating the database with data from the bridge. Future scope work will involve presenting and visualizing the bridge data as parameters are entered.

This project aims to facilitate the sharing of large data sets for research and education across Maine as well as across the Open Storage Network. It is the intention of Mount Desert Island Biological Laboratories (MDIBL) to make data files and metadata publicly available in exchange for free access. This data is of interest and value to Data Science faculty at the University of Maine Augusta, for teaching and research as part of a system-wide data science degree.

The project requires the development of a front-end and back-end system, preferably developed in Go and deployed in a container, preferably Docker. The end result will allow uploading, downloading, metadata tagging, and HPC job submissions that use the data.