More cleanup in `IREEGPUAttrs`. #31889

Job	Run time
setup / setup	6s
runtime_tracing :: tracy provider	53s
runtime :: ubuntu-20.04	1m 9s
runtime_tracing :: console provider	51s
runtime :: windows-2022	8m 24s
runtime :: macos-14	1m 29s
runtime_small	2m 24s
summary	7s
	15m 23s

Provide feedback