The fusion itself would happen at room temperature, but the process would release enough heat to boil water. Also, cold fusion doesn't mean room temperature. Compared to natural fusion, even fusion at 10k K would be considered cold.