Skip to content

Feat: fal flashpack support#12707

Open
RakshithaKowlikar wants to merge 2 commits intohuggingface:mainfrom
RakshithaKowlikar:feat-fal-flashpack-support
Open

Feat: fal flashpack support#12707
RakshithaKowlikar wants to merge 2 commits intohuggingface:mainfrom
RakshithaKowlikar:feat-fal-flashpack-support

Conversation

@RakshithaKowlikar
Copy link

What does this PR do?

This PR adds optional Flashpack integration for significantly faster model weight loading.
Read this blog to understand what flashpack is.

  • adds use_flashpack parameter to enable flashpack loading
  • automatic graceful fallback to safetensors if flashpack is unavailable or incompatible
  • supports variant parameter for specific weight files (e.g., model.fp16.flashpack)
  • feature is optional via use_flashpack=True

Fixes # (12550)

Requires optional dependency: pip install flashpack

flashpack repository: https://github.com/fal-ai/flashpack

@sayakpaul sayakpaul requested a review from DN6 November 24, 2025 12:43
@github-actions
Copy link
Contributor

github-actions bot commented Jan 9, 2026

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@github-actions github-actions bot added the stale Issues that haven't received updates label Jan 9, 2026
@yiyixuxu yiyixuxu removed the stale Issues that haven't received updates label Jan 10, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Feb 3, 2026

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

@github-actions github-actions bot added the stale Issues that haven't received updates label Feb 3, 2026
@iwr-redmond
Copy link

Pinging to remove stale again.

See also #12999 (comment) from @DN6:

There's an existing PR (#12700) for FlashPack that is a bit further along and more closely matches our expectations for file loading.

@github-actions github-actions bot removed the stale Issues that haven't received updates label Feb 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants