SYCL: Add non contiguous support in RMS_NORM and NORM kernels

[qnixsynapse]

Added non contiguous support in RMS_NORM and NORM kernels. test-backend-ops seems to pass with this change.

Edit: restored logic for handling multi subgroup correctly which was not tested by test-backend-ops

[qnixsynapse]

It now seems to pass with ne[0] = 1920

 NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.000000): OK
  NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.000000): OK
  NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.000000): OK
  NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.000000): OK
  NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.000001): OK
  NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.000001): OK
  NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.000001): OK
  NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.000001): OK
  NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.000100): OK
  NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.000100): OK
  NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.000100): OK
  NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.000100): OK
  NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.100000): OK
  NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.100000): OK
  NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.100000): OK
  NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.100000): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.000000): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.000000): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.000000): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.000000): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.000001): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.000001): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.000001): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.000001): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.000100): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.000100): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.000100): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.000100): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=0,eps=0.100000): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=0,eps=0.100000): OK
  RMS_NORM(type=f32,ne=[64,5,4,3],v=1,eps=0.100000): OK
  RMS_NORM(type=f32,ne=[1920,5,4,3],v=1,eps=0.100000): OK
  5535/5535 tests passed
  Backend SYCL0: OK

[Rbiessy]

Were you able to measure the impact on performance for this change? If it has one we may want to introduce different paths for contiguous and non-contiguous cases.

I'll try to check on my side for some relevant sizes at some point.

[qnixsynapse]

Were you able to measure the impact on performance for this change? If it has one we may want to introduce different paths for contiguous and non-contiguous cases.

I'll try to check on my side for some relevant sizes at some point.

Doesn't seem much different from master:

[llama.cpp][master]$ build/bin/llama-bench -ngl 99 -m ~/Downloads/Weights/pythia-1.4b-q4_0.gguf

model	size	params	backend	ngl	test	t/s
gptneox 1.4B Q4_0	786.31 MiB	1.41 B	SYCL	99	pp512	4202.02 ± 7.96
gptneox 1.4B Q4_0	786.31 MiB	1.41 B	SYCL	99	tg128	46.34 ± 0.25

build: 92ecdcc (5423)

[llama.cpp][sycl/non_cont_norms]$ build/bin/llama-bench -ngl 99 -m ~/Downloads/Weights/pythia-1.4b-q4_0.gguf

model	size	params	backend	ngl	test	t/s
gptneox 1.4B Q4_0	786.31 MiB	1.41 B	SYCL	99	pp512	4202.28 ± 8.47
gptneox 1.4B Q4_0	786.31 MiB	1.41 B	SYCL	99	tg128	46.25 ± 0.26

build: This PR