Well it is very long story. To make it short, the kaaba has black stone that is believed to be fallen from the sky and which was use by Abraham to build the first place of worship on the earth. All this with the will of Allah.

And remember we muslims do not worship Kaaba we worship the creator and not the creation.