Gold is valuable because it is desired, yes. It's also valuable because it is easy to transport, durable, scarce and can be broken down in to smaller bits.
Throughout history man has developed stores of value.
Throughout history, gold tends to be preferred for this task. Silver, cigarettes, shells, beads, salt have also been used.