Cement is a light-medium gray with a faint warm cast. The code used here, #9E9B95, has red, green and blue nearly level, with blue a little behind, so it reads as gray with a hint of yellow. It is almost identical to heather gray, a touch lighter and less brown than stone, and warmer than pewter.
The name comes from Portland cement, the fine gray powder sold in bags. Cement is not concrete. Mixed with water, cement forms a paste that binds sand and rock, and the hardened mix is concrete. The gray of a sidewalk is that paste plus the sand and stone in it. The odd part is the name: Joseph Aspdin called his cement Portland in 1824 because, once set, it looked like Portland stone, a pale limestone.
Cement is gray because of iron. In the kiln, limestone and clay fuse into lumps called clinker. Its minerals are mostly pale, but one, a dark brown calcium aluminoferrite, holds the iron, and with traces of manganese and chromium it gives ordinary cement its greenish-gray to brownish cast. White cement exists: makers choose raw materials with almost no iron and fire them hotter, so it costs more.
No standard defines the color. People in the xkcd survey picked a lighter, greener cement, #A5A391. The 1930 A Dictionary of Color listed cement as a textile color, filed by the 1955 ISCC-NBS dictionary as a plain medium gray, and the German RAL standard’s Cement grey is darker and greener. On screen, black text reads well on #9E9B95, at about 7.6 to 1. White text, at 2.8 to 1, is too faint even for large type.