A gas valve device in which a biased closed main valve having a diaphragm operator controls the main flow of fuel therethrough from inlet to the main outlet. Inlet pressure is applied to one side of the diaphragm to move the valve open; the other side of the diaphragm is constantly exposed to outlet pressure. A first restricted passageway leads from the inlet to the one side of the diaphragm and has an "on" and "off" control valve therein. A second passageway leading from a point in the first passageway between the control valve and diaphragm to the main outlet has a pressure regulator valve therein a nd bleeds off a portion of the inlet pressure being supplied to the one side of the diaphragm through the first passageway at a regulated rate thereby to regulate the opening movement of the main valve, and a constant restricted bypass around the pressure regulator valve vents the pressure from the one side of the diaphragm to permit closure of the main valve when the on and off control valve closes. The bypass further provides smoother regulation of the bleed off and a measure of safety against leakage of inlet pressure to the one side of the diaphragm when the control valve is closed.