[ExecuTorch] Some updated to kv cache

[kimishpatel]

Stack from ghstack (oldest at bottom):

• [Executorch][quant] Optimize per channel dequantize #5622
• [Executorch][llama] Add custom_sdpa and use that instead of sdpa_with_kv_cache #5621
• [Executorch] Update EXECUTORCH_LIBRARY macro #5620
• [Executorch][llama] Refactoring sdpa #5619
• [Executorch][llama] Update SDPA op to use quantized kv cache #5618
• Add update_quantized_cache op #5527
• Refactor custom SDPA op to separate kv cache update from the custom sdpa op #5617
• [ExecuTorch] Add quantized kv cache to llama #5616
• Fix dequantize per channel to handle double scale type #5524
• -> [ExecuTorch] Some updated to kv cache #5615

Update kv cache impl to consider untransposed cache

Differential Revision: D62301843

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5615

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 99c643e with merge base b2517d6 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[facebook-github-bot]

This pull request was exported from Phabricator. Differential Revision: D62301843