Warning

This page is located in archive.
Go to the latest version of this course pages.

Your task is to measure time performance of three different implementations of matrix multiplication and compare them:

- Standard multiplication
- Multiplication with the second matrix transposed before the multiplication
- Multiplication of the matrices in 1D representation

You probably need to do the following steps:

- Download the program from git repository: git clone https://gitlab.fel.cvut.cz/cuchymar/benchmarking.git
- Open the source code in IDE
- Run the program (cz.esw.benchmark.Main class)
- Do the measurements on each of the implementations of the matrix multiplication according to the methodology described in [1] - summary in PDF
- Determine a warm-up period for each implementation
- Visual inspection of a sequence plot is sufficient

- Measure a time performance for each implementation and compute the average performance and 95% confidence interval of the measurements (Section 9.3)
- You don't have to calculate the optimal number of repetition at each level as it is described in [1]
- Choose a sufficiently large number of repetition. The number of repetitions is important especially on the highest level.
- If the resulting confidence interval is too wide, you need to add more repetitions.

- Compute comparison ratios of the implementations and 95% confidence intervals of the ratios (Section 10.1)

- Upload a report with the results to the upload system

You can make any changes in the Main class to perform the measurements but you are not allowed to modify the MatrixUtils class.

The report should include the following parts:

- Machine specification - CPU, memory, OS, Java version (
`java -version`

), etc. - Used JVM parameters (if applied)
- Warm-up period:
- Brief description of how the warm-up period was determined
- The results (with graphs) for each implementation

- Time performance:
- Brief description of the measurement procedure
- Results including graphs with visualization of the confidence intervals

- Comparison:
- Brief description of how the comparison was done
- Resulting ratios with the confidence intervals

- Conclusions:
- Summary of the results and a discussion

- [1] https://kar.kent.ac.uk/33611/ (mainly chapters 9.3 and 10.1)
- [2] The slides from the third lecture

courses/b4m36esw/labs/lab03.txt · Last modified: 2019/03/04 19:34 by cuchymar