You can use the rock as a crude handaxe to crush and cut things, such as reed fibers to tie the wooden sticks of your hut together. You can make do with plenty of subpar sticks, but a subpar rock is going to multiply the work it takes to get a roof over your head.