Title

layout: true
<slide-template title="Sound of Databases: Sonification of a Semantic Web Database Engine" subtitle="Sven Groppe, Rico Klinckenberg, Benjamin Warnke"></slide-template>

---

class: title-slide, center, middle

<title-slide titletype="Sven Groppe, Rico Klinckenberg, Benjamin Warnke" title="Sound of Databases:" modulenumber="" subtitle="Sonification of a Semantic Web Database Engine"></title-slide>
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Sonification]

.reference[.superscript[1] Kramer et al., 1999. The sonification report: Status of the field and research agenda. International Community for Auditory Display (ICAD)]

.more-more-condensed[
- .em.darkblue[use of nonspeech audio to convey information [...] for the purposes of facilitating communication or interpretation.small-font.superscript[1]]
- Examples
  - <a href="https://youtu.be/_nAzcyVP_ZQ" target="_blank">brain acticity</a>
  - <a href="https://youtu.be/ndLkP-bNL1s" target="_blank">from deep space to cancer research</a>
  - <a href="https://youtu.be/kPRA0W1kECg" target="_blank">Sound of Sorting</a>
  - ...
- .darkblue[Motivation]
  - .darkblue[reduces barriers for people] with poor education
  - presents .darkblue[multidimensional data in an easy-to-understand way]
  - .darkblue[additional medium helps with learning] new .darkblue[information]
  - helps humans with .darkblue[visual impairments]
]

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# <img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogo.svg" align="top" width="60px"></img> .darkblue[Sound of Databases]

.more-more-condensed.no-margin[
<img src="../../img/keynotes/SoundOfDatabases/Mappings.svg" align="top" class="fullwidth"></img>
]

--
.more-more-condensed.no-margin[
- .darkblue[useful mapping for understanding] the operator algorithm<br/>(or at least its in- & output):
  - .darkblue[each operator plays another instrument] (easy to distinguish from the other)
  - .darkblue[value] of intermediate solution .darkblue[maps to pitch]
- .darkblue[mapping for melodies]: operator .darkblue[depth maps to pitch]
]

--
.more-more-condensed.no-margin[
.darkblue[<cloud-idea orientation="lt" text="...so my database now makes some sound... Let's try it!"></cloud-idea>]
]

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# First Example: .darkblue[Triple Pattern / Index Scan]

<div class="textcenter">
<video class="halfwidth" controls>
  <source src="../../img/keynotes/SoundOfDatabases/1_IndexScan.mp4" type="video/mp4">
  Your browser does not support the video tag.
</video>
</div>

--
.more-more-condensed.no-margin[
- .darkblue[We learn:] Semantic Web data often .darkblue[stored in indices]
  - Output is .darkblue[pre-sorted]
  - .darkblue[Maximize] usage of fast .darkblue[merge joins]
]

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 1/4]

- .darkblue[Guess: What kind of operator do you hear?]

<div class="textcenter">
<audio controls>
  <source src="../../img/keynotes/SoundOfDatabases/2_Filter.mp3" type="audio/mpeg">
  Your browser does not support the audio element.
</audio>
</div>

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 1/4] - Solution

- .darkblue[Select] / Filter

<div class="textcenter">
<video class="halfwidth" controls>
  <source src="../../img/keynotes/SoundOfDatabases/2_Filter.mp4" type="video/mp4">
  Your browser does not support the video tag.
</video>
</div>
.no-margin.more-more-condensed[
- not all intermediate results are passing the filter operator
]

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 2/4]

- .darkblue[Guess: What kind of operator do you hear?]

<div class="textcenter">
<audio controls>
  <source src="../../img/keynotes/SoundOfDatabases/3_MergeJoin.mp3" type="audio/mpeg">
  Your browser does not support the audio element.
</audio>
</div>

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 2/4] - Solution

- .darkblue[Merge Join]

<div class="textcenter">
<video class="halfwidth" controls>
  <source src="../../img/keynotes/SoundOfDatabases/3_MergeJoin.mp4" type="video/mp4">
  Your browser does not support the video tag.
</video>
</div>
.no-margin.more-more-condensed[
- only if the two inputs of the index scan operators are the same, an output is generated
]

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 3/4]

- .darkblue[Guess: What kind of operator do you hear?]

<div class="textcenter">
<audio controls>
  <source src="../../img/keynotes/SoundOfDatabases/4_LeftOuterJoin.mp3" type="audio/mpeg">
  Your browser does not support the audio element.
</audio>
</div>

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 3/4] - Solution

- .darkblue[Left Outer Join] / Optional-Clause of SPARQL Queries

<div class="textcenter">
<video class="halfwidth" controls>
  <source src="../../img/keynotes/SoundOfDatabases/4_LeftOuterJoin.mp4" type="video/mp4">
  Your browser does not support the video tag.
</video>
</div>
.no-margin.more-more-condensed[
- the input of the left index scan passes always the left outer join - even if it is not combined with the input of the right index scan
]

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 4/4]

- .darkblue[Guess: What kind of operator do you hear?]

<div class="textcenter">
<audio controls>
  <source src="../../img/keynotes/SoundOfDatabases/5_HashJoin.mp3" type="audio/mpeg">
  Your browser does not support the audio element.
</audio>
</div>

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Quiz 4/4] - Solution

- .darkblue[Hash Join]

<div class="textcenter">
<video class="halfwidth" controls>
  <source src="../../img/keynotes/SoundOfDatabases/5_HashJoin.mp4" type="video/mp4">
  Your browser does not support the video tag.
</video>
</div>
.no-margin.more-more-condensed[
- merge join of two triple patterns and a succeeding hash join
- hash join is implemented as pipeline breaker by generating the output after reading the complete input of one operator
]

---
<img src="../../img/keynotes/SoundOfDatabases/SoundOfDatabasesLogoBackground.svg" align="top" width="60px" style="position:fixed;right:5px;top:5px"></img>

# .darkblue[Sonification of Complex Queries]

<div class="textcenter">
<video class="halfwidth" controls>
  <source src="../../img/keynotes/SoundOfDatabases/6_ComplexQuery.mp4" type="video/mp4">
  Your browser does not support the video tag.
</video>
</div>