Tag Archives: Big Data

  • The Challenges of Updating Scientific Codes for New HPC Architectures

    In this video from PASC19 in Zurich, Benedikt Riedel from the University of Wisconsin describes the challenges researchers face when it comes to updating their scientific codes for new HPC architectures. After that he describes his work on the IceCube Neutrino Observatory. The IceCube Neutrino Observatory is the first detector of its kind, designed to observe the cosmos from…

    Read Article
  • Open Source vs. Commercial Parallel File Systems: Truth and Fiction in a HPC World

    In the fast-paced world of HPC, data storage is an essential component in guaranteeing business critical deliverables. HPC data storage systems rely on parallel file systems to deliver maximum performance – but CIOs have two options to choose from, as Jim Donovan explores High-Performance Computing (HPC) and its ability to store, process and analyse vast…

    Read Article
  • New Twists in the Intertwining of HPC and AI

    The alliance between high performance computing and artificial intelligence is proving to be a fruitful one for researchers looking to accelerate scientific discovery in everything from climate prediction and genomics to particle physics and drug discovery. The impetus behind this is to use AI, and machine learning in particular, to augment the predictive capacity of…

    Read Article
  • Berkeley Lab’s John Shalf Ponders the Future of HPC Architectures

    Editor’s note: Ahead of John Shalf’s well-attended and well-received “high-bandwidth” keynote at ISC 2019, Shalf discussed the talk’s major themes in an interview with Berkeley Lab’s Kathy Kincade.  What will scientific computing at scale look like in 2030? With the impending demise of Moore’s Law, there are still more questions than answers for users and…

    Read Article
  • From the Oceans to the Cloud: Opportunities and Challenges for Data, Models, Computation and Workflows

    Abstract: Advances in ocean observations and models mean increasing flows of data. Integrating observations between disciplines over spatial scales from regional to global presents challenges. Running ocean models and managing the results is computationally demanding. The rise of cloud computing presents an opportunity to rethink traditional approaches. This includes developing shared data processing workflows utilizing…

    Read Article
  • The Five Commandments of Big Data Cloud Migration

    With data cloud migration you can’t muscle your way in. Brute doesn’t work for moving and maintaining petabytes of data. Brute force works for stuck lug nuts – less so for moving and maintaining petabytes of data. Joel Horwitz, SVP Marketing Strategy, WANdisco takes up the tale The five commandments of big data cloud migration….

    Read Article