University of South Dakota
University of South Dakota (USD) operates two supercomputer systems, the Lawrence Supercomputer and the Legacy Supercomputer. Coupled with advanced data platforms and high-speed research networks, and managed by the USD Research Computing Group (USDRCG), these advanced digital resources are employed to accelerate computational and data-driven research and scholarship. Their mission is to leverage this cyberinfrastructure to reduce time to discovery – growing the number of affiliated research practicioners and increasing USD’s competitiveness for research funding. Access is free to all non-commercial entities in South Dakota.
A core requirement of our solution was its shareability across all stakeholders. BlackPearl’s hybrid ecosystem easily manages our research data, moving it seamlessly to tiers of storage, while greatly improving both data accessibility and usability for USD researchers and administrators alike.
– Douglas Jennewein, Director of Research Computing at the University of South Dakota
Slagle Hall houses the Spectra Verde appliance.
The BlackPearl and T380 are offsite at USD’s University Center Data Center in Sioux Falls.
Located in Vermillion, South Dakota, the University of South Dakota Research Computing Group advances discovery by making science, engineering, and medicine more productive. The USDRCG serves the University of South Dakota academic community, as well as collaborators both nationally and internationally. To that end, USD operates two supercomputers, named Lawrence and Legacy, that boast over 2000 and 680 cores respectively. Lawrence entered production in early 2018 and has an estimated performance of over 100 TFLOPS.
USD’s supercomputing user base has grown from a small cohort of bioinformatics faculty in 2006 to virtually all Science Technology Engineering and Mathematics disciplines, with emerging cases in the humanities. Their existing cyberinfrastructure had a maximum capacity of 470TB across both supercomputers. Additionally, individual laboratories managed their own data storage capabilities locally, posing a significant obstacle to cross-campus data accessibility and collaboration.
To manage a growing supercomputing infrastructure and expanding user base, USD launched the South Dakota Data Store (SDDS) project. The SDDS proposed two service tiers to serve all faculty, staff, postdocs, students and graduate students in South Dakota – the Sharing Tier and the Archival Tier.
To store their research data, USD deployed a Spectra® Verde® NAS solution, BlackPearl® Converged Storage System and a T380 Tape Library with LTO drives. By installing the Verde NAS with 8TB SAS drives as the local file system on one site, and the BlackPearl and T380 as the research archive platform at another site, USD implemented a multi-tier, storage-diverse architecture that enabled the high data reliability and availability they desired. USD’s complete Spectra solution balances the accessibility of network-attached storage with the long-term protection, cost benefits and scalability of a hybrid storage system leveraging tape.
BlackPearl’s tight integration with the Globus research data management platform allows the USD Research Computing Group to talk to all storage targets through one single interface. The Verde NAS is used with Globus as NFS/ CIFS file storage, and also as a landing zone to stage archival data. Cyberduck and Spectra’s free and open source EON Browser are used to send any additional unmanaged data to the Archive Tier through BlackPearl. Their new system should easily increase capacity tenfold, and enables accessibility to a shared pool of storage from multiple sites.
Finally, the organization needed to move tens of terabytes onto the new system. The Spectra solution enabled USD to migrate off of a disk-based archive. BlackPearl’s migration capabilities allow data to be moved from one storage type to another quickly and transparently, transferring data in the background while users continue to access assets without disrupting operations.
- Spectra BlackPearl Converged Storage System
- Spectra 4U Verde NAS Solution
- Spectra T380 Tape Library
- Globus research data management platform
- Cyberduck client software
- Spectra EON Browser
- Spectra Certified Media
- Storage diversity
- NFS to object storage pathway
- Integration with Globus