More often than not the weather in Reykjavik all through August is 9, with highs being around 13 degrees with a low of 8 celsius. We have put some more information here:

MonthDegrees Celsius
High Temperature13
Low Temperature8
Sunshine Per Day6

Click to see more Reykjavik Weather including Reykjavik, Iceland July Weather and Reykjavik, Iceland September Weather