First of all, nail a cleat to the timber fence post then nail the gravel board into the face of the cleat.