Efficient long-term open-access data archiving in mining industries

Efficient data collection, analysis and preservation are needed to accomplish adequate business decision making. Long-lasting and sustainable business operations, such as mining, add extra requirements to this process: data must be reliably preserved over periods that are longer than that of a typical software life-cycle. These concerns are of special importance for the combined on-line-on-mine-real-time expert system SOLSA (http://www.solsa-mining.eu/) that will produce data not only for immediate industrial utilization, but also for the possible scientific reuse. We thus applied the experience of scientific data publishing to provide efficient, reliable, long term archival data storage. Crystallography, a field covering one of the methods used in the SOLSA expert system, has long traditions of archiving and disseminating crystallographic data. To that end, the Crystallographic Interchange Framework (CIF, [1]) was developed and is maintained by the International Union of Crystallography (IUCr). This framework provides rich means for describing crystal structures and crystallographic experiments in an unambiguous, humanand machine- readable way, in a standard that is independent of the underlying data storage technology. The Crystallography Open Database (COD, [2]) has been successfully using the CIF framework to maintain its open-access crystallographic data collection for over a decade [3,4]. Since the CIF framework is extensible it is possible to use it for other branches of knowledge. The SOLSA system will generate data using different methods of material identification: XRF, XRD, Raman, IR and DRIFT spectroscopy. For XRD, the CIF is usable out-of-the-box, since we can rely on extensive data definition dictionaries (ontologies) developed by the IUCr and the crystallographic community. For spectroscopic techniques such dictionaries, to our best knowledge, do not exist; thus, the SOLSA team is developing CIF dictionaries for spectroscopic techniques to be used in the SOLSA expert system. All dictionaries will be published under liberal license and communities are encourage to join the development, reuse and extend the dictionaries where necessary. These dictionaries will enable access to open data generated by SOLSA by all interested parties. The use of the common CIF framework will ensure smooth data exchange among SOLSA partners and seamless data publication from the SOLSA project.