Helium's heat capacity is 0.000927 J/(cm³˚C). While it's almost twice as dense as hydrogen, it's specific heat capacity is nearly 3 times lower at 5193, not that much above water. Also liquid helium is very hard to obtain as it's boiling point is 4.126K.
On the other hand, as you say it's completely inert.
