ETP4HPC - BDVA Common Workshop

ETP4HPC and BDVA held a joint workshop in order to synchronise the efforts of the two organisations and find 'a common language' in dealing with the Big Data and HPC challenges. This is the agenda of the event (2nd page). This workshop was organised within an EXDCI Technical Workshop and the material from this event is available on a dedicated web page on the  website of EXDCI.

The topics covered were:

• Common HPC and BD glossary: Determine a common reference to understand possible relationships between a typical HPC stack and a BD Analytics stack
• Cross-Pollination of HPC and BD technologies: What respective technologies/approaches from a HPC stack or a BD Analytics stack can benefit the other’s needs e.g respective hybrid systems that incorporate select elements from either HPC of BD technologies/approaches
• Extreme BD workloads: Understand bottlenecks through better appreciation of centralised and decentralised processing of extreme big data workloads
• Collaboration between HPC CoEs and BD CoEs: Facilitate better communication between HPC’s CoEs (https://exdci.eu/collaboration/coe) and BD CoEs (http://i-know.tugraz.at/european-network/)
• Update on Extreme-scale Demonstrators (ESDs) and Exascale co-design
• User engagement: Understanding user base (UX Analysis) and the need for skills development and business models
• Exploring options for possible collaborations in view of the forthcoming WP 2018-2020

The main conclusions are:

• Artificial Intelligence could play an important role in bridging the two areas
• The big data use cases, which BDVA has assembled, can provide a basis for work with the involvement of the EsDs

A report will be produced to summarise the workshop - and it will be used in SRA 3. Also, we will soon publish the presentations used.