[tests] make quanto tests device-agnostic

[faaany]

What does this PR do?

This PR makes tests under test_quanto.py device-agnostic. Except the skipped cases, all passed on XPU:

PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoConfigTest::test_attributes
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoTestIntegration::test_conversion_with_modules_to_not_convert
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoTestIntegration::test_weight_and_activation_quantization_conversion
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoTestIntegration::test_weight_only_quantization_conversion
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationTest::test_compare_with_quanto
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationTest::test_generate_quality_cpu
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationTest::test_generate_quality_gpu
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationTest::test_quantized_model_layers
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationTest::test_serialization_bin
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationTest::test_serialization_safetensors
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationOffloadTest::test_check_offload_quantized
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationOffloadTest::test_generate_quality_gpu
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationOffloadTest::test_quantized_model_layers
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorTest::test_compare_with_quanto
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorTest::test_generate_quality_cpu
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorTest::test_generate_quality_gpu
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorTest::test_quantized_model_layers
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorTest::test_serialization_bin
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorTest::test_serialization_safetensors
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorOffloadTest::test_check_offload_quantized
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorOffloadTest::test_generate_quality_gpu
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationQBitsTensorOffloadTest::test_quantized_model_layers
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoQuantizationActivationTest::test_quantize_activation
PASSED tests/quantization/quanto_integration/test_quanto.py::QuantoKVCacheQuantizationTest::test_quantized_cache

cc @ydshieh

[ydshieh]

Great!

[SunMarc]

Thanks for your work !