Generally the typical temperate in Reykjavik through the month of January is 1. You can expect a high of 3 and low average expected to be -3. The table below has further info:

MonthDegrees Celsius
High Temperature3
Low Temperature-3
Sunshine Per Day2

Click to see more Reykjavik Weather including Reykjavik, Iceland February Weather