Telephone: 0114 2572 200
Email: info@ocf.co.uk

Arif Ali: An evolutionary decade in HPC

“Over the last decade what I have witnessed is that lots of people can now see what server clusters can do for them.”

I haven’t quite managed a full 10-years in the HPC industry yet, but I’m only a few months short and I really wanted to talk about the past decade nonetheless, just so much has happened. None of it is a surprise I’ll hasten to add [not because of a crystal ball] but because its been an evolutionary period.

In terms of interconnects I can clearly recall the evolution of using technology from Wulfkit then Myrinet [the latter we installed at University of Reading and Air Bus] and now we use InfiniBand as standard. It’s been a natural progression to ever better, faster technologies. InfiniBand has now become completely mainstream and I’m actually looking forward to seeing InfiniBand progress further to become a PC networking tool in the future. That’s my tip for you!

Processor technology manufacture has switched between two firms, from AMD in the early years, where we sold AMD clusters to the likes of University of Southampton and Red Bull, to Intel today. Intel’s Nehalem processor made a big impact, then Intel’s Westmere [of which OCF was responsible for first UK deployment in IBM iDataPlex servers] and now we’ve got Intel’s Sandy Bridge processor doing the same. AMD should have done better to combat Intel’s challenge, considering how well they were performing only a few years ago. I would really hope to see them back in HPC soon.

On the same topic of processors, I think the biggest disappointment of the last decade has been the failure of Cell processors to take hold. I remember the launch and near immediate withdrawal of IBM’s cell-based machines, the BladeCenter QS22 blade server. It is such as shame considering they had helped to power supercomputers like RoadRunner to the top of the rankings for a time. Here’s tip number two, I’m looking forward to the impact that ARM’s CPUs will have on the industry – definitely one to watch.

Software has ‘come on’ leaps and bounds too, but I think we’re still some way off making software automatically work across a cluster – with a one-click install. We’re increasingly working with the software vendors, but one-click install is still tough. By contrast, cluster implementation has become easier, one-click installations / re-installations are possible and we’ve reduced integration time for servers from 2 hours to 15 minutes.

Over the last decade what I’ve witnessed is that lots of people have now seen what high performance server clusters can do for them. As such, server clusters are becoming much more business critical – we not installing standalone systems anymore, kept isolated from the rest of the IT infrastructure. We’re being asked to integrate clusters with existing systems, firewalls, gateways and storage systems. Clusters have evolved to become a whole part of the business.

Comments

3 Comments

  • Wadud Miah says:

    I think there has been great advances in HPC hardware which is mentioned, but what is not mentioned at all is the huge challenge in developing scalably scientific applications that can make efficient usage of the available powerful hardware. The software challenge is much greater than the hardware challenege and I think focus needs to be made on the application side of things more than hardware.

  • Andy Dean says:

    Hi Wadud, actually I completely agree with you. Software development for HPC is always behind the curve hindering growth. Unlike hardware which accelerates at a set pace, software development is more vague. It is often because of the dispersed, uncoordinated nature of software teams, i.e. multiple vendors and in-house developers, but no single company or issue driving innovation. I also think the industry is suffering from not having enough people learning modern software; we are seeing people in industry with the wrong skill sets. However, through projects like Bloodhound and the Hartree Centre, software skills are improving, but more focus is still needed.

  • Nayna says:

    hi, I think there has been great advances in HPC hardware which is mentioned, but what is not mentioned at all is the huge challenge in developing scalable scientific applications that can make efficient usage of the available powerful hardware. The software challenge is much greater than the hardware challenge and I think focus needs to be made on the application side of things more than hardware.

  • Leave a Reply

    Your email address will not be published. Required fields are marked *

    Contact Us

    HEAD OFFICE:
    OCF plc
    Unit 5 Rotunda, Business Centre,
    Thorncliffe Park, Chapeltown,
    Sheffield, S35 2PG

    Tel: +44 (0)114 257 2200
    Fax: +44 (0)114 257 0022
    E-Mail: info@ocf.co.uk

    SUPPORT DETAILS:
    OCF Hotline: 0845 702 3829
    E-Mail: support@ocf.co.uk
    Helpdesk: support.ocf.co.uk

    DARESBURY OFFICE:
    The Innovation Centre, Sci-Tech Daresbury,
    Keckwick Lane, Daresbury,
    Cheshire, WA4 4FS

    Tel: +44 (0)1925 607 360
    Fax: +44 (0)114 257 0022
    E-Mail: info@ocf.co.uk

    OCF plc is a company registered in England and Wales. Registered number 4132533. Registered office address: OCF plc, 5 Rotunda Business Centre, Thorncliffe Park, Chapeltown, Sheffield, S35 2PG

    Website Designed & Built by Grey Matter | web design sheffield