Yeah, I'm using one of those rectangular, boxy switches from a 1970 VW, which shares a design from the earlier version, just with a few more contacts on it. I had to recess tbehind the dash to allow it to fit in there and have enough of the bezel collar protrude to fit the circular trim nut on. Within the switch is a plunger connected via the shaft to the knob. Pull out the knob and the plunger slides back and forth across a set of bump contacts to configure the circuits for off, parking lights and headlights, depending on how far out you pull the knob. Along with that are other contacts for the dash lights (via a rheostat connected to the shaft) and a feed for a few other circuits, some of which aren't even related to the lighting circuits, just that it was easier for the designers to pull some power off of the hot side of the switch (tabs 30, 30a and 30b) to elsewhere in the dash.
Put all that together and there's a lot going on with that switch. My non-professional but experienced eye tells me the contacts are good for about 15 amps max (including the headlights themselves) and most speedsters are pulling all of that. Now throw in the fact that the switch is probably 40 years old and way beyond it's useful life and you have to expect that the contacts will be worn out and failing, with higher resistance and dimmer lights.
A poor ground will cause lights to dim immediately nearby or cause a wider set of lights to dim opposite to their normal operation (turn them on, they get dimmer. Turn them off, they get brighter) but if several different circuits are acting in the same manner I would suspect their 12V feed through a common denominator switch. Could it still be a ground? Sure - but I would check the +12V side first.