Releases: paritytech/subxt
v0.43.0
[0.43.0] - 2025-07-17
This is a reasonably small release which is mainly bug fixing, but has a couple of changes I'd like to elaborate on:
Remove codec::Encode
and codec::Decode
derives from generated APIs by default (#2008)
When generating an API using the #[subxt::subxt(...)]
macro (or programatically via subxt-codegen
), we had always previously added parity_scale_codec::Encode
and parity_scale_codec::Decode
derives to all of the generated types. Most places in Subxt have not made use of these for a long time (relying instead on scale_encode::EncodeAsType
and scale_decode::DecodeAsType
, since they allow encoding and encoding which takes the type information into account and can more gracefully handle incompatibilities).
We eventually hit an issue to which the most appropriate fix was just to remove these derives.
If you still need the parity_scale_codec::Encode
or parity_scale_codec::Decode
derives on certain types, you have two options:
- Use the
derive_for_type
attr to add them back where needed, eg:#[subxt::subxt( ... derive_for_type( path = "staging_xcm::v3::multilocation::MultiLocation", derive = "parity_scale_codec::Encode, parity_scale_codec::Decode", recursive ) )]
- Use the
derive_for_all_types
attr to add them back everywhere, eg:#[subxt::subxt( ... derive_for_all_types = "parity_scale_codec::Encode, parity_scale_codec::Decode" )]
Prefer (1) where possible to reduce the amount of generated code, and reduce the likelihood of running into issues around those derives in certain edge cases.
This PR changes some things around storage keys to remove one last requirement for Encode
and Decode
derives, and also as a side effect changes api.storage().call_raw()
slightly to no longer also try to decode the resulting type via Decode
, leaving this to the user (and also meaning it's much easier now for the user to obtain the raw bytes for some storage entry).
In other words, instead of doing something like:
let (compact_len, metadata) = rt
.call_raw::<(Compact<u32>, frame_metadata::RuntimeMetadataPrefixed)>(
"Metadata_metadata",
None,
)
.await?;
You would now do:
let meta_bytes = rt.call_raw("Metadata_metadata", None).await?;
let (compact_len, metadata): (Compact<u32>, frame_metadata::RuntimeMetadataPrefixed) =
Decode::decode(&mut &*meta_bytes)?;
Address some issues around tx mortality (#2025)
Prior to this change, the intended behavior was that any transaction submitted via an OnlineClient
would have a mortality of 32 blocks by default, and any transaction submitted via an OfflineClient
would be immortal by default. A couple of issues were present or cropped up however:
- If you explicitly configure the mortality via setting params like
PolkadotExtrinsicParamsBuilder::new().mortal(32).build()
, theOfflineClient
transaction would still be immortal, because it didn't have enough information to properly configure the mortality as asked for (by virtue of being offline and unable to fetch it). - The intended behaviour turned out to have been broken, and transactions were being submitted as immortal even via the
OnlineClient
by default, unless mortality was explicitly configured. - There was no easy way to actually set the mortality for an
OfflineClient
transaction; you'd have to do something like this:let params = DefaultExtrinsicParamsBuilder::new(); params.5 = CheckMortalityParams::mortal_from_unchecked(for_n_blocks, from_block_n, from_block_hash);
With this PR, transactions are now mortal by default using the OnlineClient
, we now return an error if you try to construct a transaction with the OfflineClient
and try to use params.mortal(..)
when configuring it, and we expose params.mortal_from_unchecked(..)
to allow configuration for offline transactions without the ugly code above.
In this PR, we also discovered an issue decoding Eras
and fixed this, so that decoding the mortality of a transaction when it is mortal should now work.
Add FFI example (#2037)
I'd like to do a quick shoutout to @wassimans, who submitted an excellent example for how to interact with Subxt via the C FFI in Python and Node.JS. This is something I've wanted to add for a while, so it's lovely to see this new example which highlights one of the strengths of Subxt over Javascript based compatitors in the space.
All of the non-trivial changes in this release are listed below:
Added
- Add FFI example (#2037)
Changed
- Remove
codec::Encode
andcodec::Decode
derives from generated APIs by default (#2008) - Address some issues around tx mortality (#2025)
Fixed
- Fix 'subxt explore storage': don't turn keys to bytes (#2038)
- Refactor: improve nonce and block injection in extrinsic params (#2032)
- Improve docs for
at_latest
(#2035) - Clippy fixes for latest Rustc (#2033)
- docs: fix minor comment typos (#2027)
- chore: remove redundant backtick in comment (#2020)
- Keep codec attrs even when Encode/Decode not used (#2023)
- Run CI on v0.N.x branches or PRs to them for ease of backporting (#2017)
- De-dup types early in CLI/macro so that derives/substitutes work for de-duped types (#2015)
- If only one hasher, always treat any key as a single and not NMap key, even if it's a tuple. (#2010)
v0.42.1
v0.42.0
[0.42.0] - 2025-05-09
The primary benefit of this release is introducing support for the about-to-be-stabilised-in-polkadot-sdk V16 metadata, and with that, support for calling Pallet View Functions on runtimes which will support this. Pallet View Functions are used much like Runtime APIs, except that they are declared in specific pallets and not declared at the runtime-wide level, allowing pallets to carry their own APIs with them.
Pallet View Functions
Calling a Pallet View Function in this Subxt release will look like:
use runtime::proxy::view_functions::check_permissions::{Call, ProxyType};
// Construct the call, providing the two arguments.
let view_function_call = runtime::view_functions()
.proxy()
.check_permissions(
Call::System(runtime::system::Call::remark { remark: b"hi".to_vec() }),
ProxyType::Any
);
// Submit the call and get back a result.
let _is_call_allowed = api
.view_functions()
.at_latest()
.await?
.call(view_function_call)
.await?;
Like Runtime APIs and others, the dynamic API can also be used to call into Pallet View Functions, which has the advantage of not needing the statically generated interface, but the downside of not being strongly typed. This looks like the following:
use scale_value::value;
let metadata = api.metadata();
// Look up the query ID for the View Function in the node metadata:
let query_id = metadata
.pallet_by_name("Proxy")
.unwrap()
.view_function_by_name("check_permissions")
.unwrap()
.query_id();
// Construct the call, providing the two arguments.
let view_function_call = subxt::dynamic::view_function_call(
*query_id,
vec![
value!(System(remark(b"hi".to_vec()))),
value!(Any())
],
);
// Submit the call and get back a result.
let _is_call_allowed = api
.view_functions()
.at_latest()
.await?
.call(view_function_call)
.await?;
Updated Config
trait
Another change to be aware of is that our Config
trait has been tweaked. The Hash
associated type is no longer needed, as it can be obtained via the Hasher
associated type already, and PolkadotConfig
/SubstrateConfig
now set the hasher by default to be DynamicHasher256
, which will (when V16 metadata is available for a runtime) automatically select between Keccak256 and BlakeTwo256 hashers depending on what the chain requires.
Other changes
We also solidify our support for V1 archive RPCs, upgrade the codebase to Rust 2024 edition, and a bunch of other changes, the full list of which is here:
Added
- Support v16 metadata and use it by default if it's available (#1999)
- Metadata V16: Implement support for Pallet View Functions (#1981)
- Metadata V16: Be more dynamic over which hasher is used. (#1974)
Changed
- Update to 2024 edition (#2001)
- Update Smoldot to latest version (#1991)
- Update native test timeout to 45 mins (#2002)
- chore(deps): tokio ^1.44.2 (#1989)
- Add DefaultParams to allow more transaction extensions to be used when calling _default() methods (#1979)
- Use wat instead of wabt to avoid CI cmake error (and use supported dep) (#1980)
- Support v1 archive RPCs (#1977)
- Support V16 metadata and refactor metadata code (#1967)
- Allow submitting transactions ignoring follow events (#1962)
- Improve error message regarding failure to extract metadata from WASM runtime (#1961)
- Add docs for subxt-rpcs and fix example (#1954)
Fixed
v0.41.0
[0.41.0] - 2025-03-10
This release makes two main changes:
Add subxt-rpcs
crate.
Previously, if you wanted to make raw RPC calls but weren't otherwise interested in using the higher level Subxt interface, you still needed to include the entire Subxt crate.
Now, one can depend on subxt-rpcs
directly. This crate implements the new RPC-V2 chainHead
/transaction
endpoints as well as the currently unstable archive
endpoints. it also implements various legacy endpoints that Subxt uses as a fallback to the modern ones. It also provides several feature gated clients for interacting with them:
- jsonrpsee: A
jsonrpsee
based RPC client for connecting to individual RPC nodes. - unstable-light-client: A Smoldot based light client which connects to multiple nodes in chains via p2p and verifies everything handed back, removing the need to trust any individual nodes.
- reconnecting-rpc-client: Another
jsonrpsee
based client which handles reconnecting automatically in the event of network issues. - mock-rpc-client: A mock RPC client that can be used in tests.
Custom clients can be implemented if preferred.
Example usage via jsonrpsee
feature:
use subxt_rpcs::{RpcClient, ChainHeadRpcMethods};
// Connect to a local node:
let client = RpcClient::("ws://127.0.0.1:9944").await?;
// Use chainHead/archive V2 methods:
let methods = ChainHeadRpcMethods::new(client);
// Call some RPC methods (in this case a subscription):
let mut follow_subscription = methods.chainhead_v1_follow(false).await.unwrap();
while let Some(follow_event) = follow_subscription.next().await {
// do something with events..
}
Support creating V5 transactions.
Subxt has supported decoding V5 transactions from blocks since 0.38.0, but now it also supports constructing V5 transactions where allowed. Some naming changes have also taken place to align with the Substrate terminology now around transactions (see #1931 for more!).
The main changes here are:
subxt_core
now contains versioned methods for creating each of the possible types of transaction (V4 unsigned, V4 signed, V5 "bare" or V5 "general"), enabling the APIs to be tailored for each case.subxt
exposes higher level wrappers these (ieapi.tx().create_v4_unsigned(..)
,api.tx().create_v5_bare(..)
), but also continues to expose the same standard APIs for creating transactions which will, under the hood, decide what to create based on the chain we're connected to.- APIs like
sign_and_submit
now take aT::AccountId
rather than aT::Address
since it was found to not be useful to provide the latter, and V5 transactions only expect anT::AccountId
. - Signed Extensions are now referred to as Transaction Extensions, and we've tweaked the interface around how these work slightly to accomodate the fact that in V5 transactions, the signature is passed into a transaction extension where applicable (
VerifySignature
). - As a side effect, it's simpler to set mortality on transactions; no more block hash needs to be provided; only the number of blocks you would like a transaction to live for.
A full list of the relevant changes is as follows:
Added
- Support constructing and submitting V5 transactions (#1931)
- Add archive RPCs to subxt-rpcs (#1940)
- Document generating interface from Runtime WASM and change feature to
runtime-wasm-path
(#1936) - Split RPCs into a separate crate (#1910)
Changed
v0.40.0
[0.40.0] - 2025-03-06
This release reverts the usage of the polkadot-sdk umbrella crate, which was causing issues such as an increased number of dependencies in Cargo.lock. For more details, see #1925.
Additionally, this update bumps the Polkadot SDK-related dependencies to their latest versions, ensuring compatibility and stability.
Fixed
- Remove usage of polkadot-sdk umbrella crate (#1926)
Full Changelog: v0.39.0...v0.40.0
v0.39.0
[0.39.0] - 2025-02-04
This release is mostly bug fixes and changes. The only change that should be a breaking change is removing the substrate-compat
feature flag (see #1850), which we'll go into more detail about.
The substrate-compat
feature flag has been removed.
The substrate-compat
feature flag essentially provided:
- An implementation of the
subxt::config::Header
trait for anything implementingsp_runtime::traits::Header
(here). - Same for
subxt::config::Hasher
and anything implementingsp_runtime::traits::Hasher
(here). - A
subxt_core::tx::PairSigner
type which could be given something implementingsp_core::Pair
and then be used to sign transactions (here). - From impls for
sp_runtime::AccountId32
and related forsubxt::utils::AccountId32
(here). - Likewise for
sp_runtime::MultiAddress
andsubxt::utils::MultiAddress
(here). - Likewise for
sp_runtime::MultiSignature
andsubxt::utils::MultiSignature
(here).
While useful, providing these features in Subxt is almost impossible to maintain: we can only support a single version of sp_runtime
/sp_core
at a time, but many versions are in use in the wild. This led to various issues regarding the mismatch between sp_*
crates in use and a given version of Subxt. More generally, the goal of Subxt is to be independent from any specific version of Substrate, and communicate via the exposed RPC APIs in order to work across any compatible Substrate version (or indeed, alternative implementations that follow things like the RPC spec).
As a result, we've taken the decision to remove this compatibility layer from Subxt itself. To migrate away from this feature, we suggest:
- Using the example here to see how to use a Substrate signer to sign Subxt transactions.
- Looking at
subxt_signer
instead, if it's a viable alternative in your case. - Following the "here" links above to see what impls were removed. Impls can generally be recreated as needed using wrapper types which allow converting between Substrate and Subxt types/traits, for instance:
// Wrap a substrate header type in this to impl the subxt Header trait:
struct SubxtHeader<T>(pub T);
// This basically copies the code removed from Subxt, but on a wrapper type:
impl <T> subxt::config::Header for SubxtHeader<T>
where
T: sp_runtime::traits::Header,
<T as sp_runtime::traits::Header>::Number: Into<u64>,
{
type Number = T::Number;
type Hasher = T::Hashing;
fn number(&self) -> Self::Number {
*self.0.number()
}
}
The hope is that this pattern is applicable to any such types that you find useful to share between Substrate and Subxt code. Please raise an issue if you can't find a solution in your case, and we'll endeavour to help!
The result of this is that your code will work against whichever Substrate crate versions you are using, at the cost of this code no longer being included behind the substrate-compat
feature flag.
A full list of relevant changes and fixes (nothing was added in this release) is as follows:
Changed
- remove substrate compat (#1850)
- migrate custom error trait impls to
thiserror
(#1856) - re-export
jsonrpsee
insubxt::ext
(#1843)
Fixed
- don't double hash: use the same hash in ExtrinsicDetails and ExtrinsicDetails (#1917)
- fix and test sr25519 signing in nostd (#1872)
- preserve custom metadata when converting between Subxt metadata and frame_metadata (#1914)
- fix: don't wrap rpc error in DisconnectedWillReconnect in reconnecting rpc client (#1904)
- fix: substrate runner, support new libp2p addr log (#1892)
- update Artifacts (auto-generated) (#1874)
- bump frame-decode and frame-metadata to latest (#1870)
- fix unstable-light-client + ChainHeadBackend tx events (#1865)
- when native feature is enabled, we need polkadot-sdk/std for eg examples to work (#1864)
- load latest metadata version from Wasm blobs. (#1859)
- minor fix - Yew example (#1852)
- update the release notes to work for current releases (#1842)
v0.38.1
[0.38.1] - 2025-01-24
This is a bug-fix release that fixes a bug in the reconnecting-rpc-client
where the error was wrapped in the wrong error variant
which kept retry logic to keep retrying the same error indefinitely.
Fixed
- don't wrap rpc error in DisconnectedWillReconnect in reconnecting rpc client (#1904)
Full Changelog: v0.38.0...v0.38.1
v0.38.0
[0.38.0] - 2024-10-24
This release doesn't introduce any substantial breaking changes and focuses primarily on incremental improvements, testing and bug fixes. A few of the highlights include:
- #1785: Support decoding V5 extrinsics in blocks (currently Subxt will still submit V4 extrinsics). This also unifies our extrinsic decoding logic into one place.
- #1802: Stabilizing the
subxt::backend::unstable::UnstableBackend
(it's now calledsubxt::backend::chain_head::ChainHeadBackend
). This backend can be used to interact with the modernchainHead
RPC methods exposed by Smoldot and compliant RPC nodes. See this example. - #1803: Stabilizing the
reconnecting-rpc-client
. See this example. - #1720: A nice little QoL improvement if you have the raw runtime WASM and would like to generate an interface directly from that (ie with
#[subx(runtime_path = "path/to/runtime.wasm")]
). - #1661: Support loading keys directly from the PolkadotJS JSON to be used in Subxt.
- #1638: Improve support for Eth style chains by defining a 20-byte account ID type directly in
subxt-core
. See this example.
The notable changes in this release are as follows:
Added
- add reconnecting tests for unstable_backend (#1765)
- add support for generating metadata from runtime wasm files (#1720)
- support loading keys from Polkadot-JS accounts (#1661)
- allow tx payloads to be boxed (#1690)
- add hash method to ExtrinsicDetails (#1676)
- expose
secret_key
method forecdsa::Keypair
andeth::Keypair
(#1628) - add 20-byte account id to subxt_core (#1638)
Changed
- make it clearer which extrinsic failed to decode (#1835)
- chore(deps): bump frame-metadata from 16 to 17 (#1836)
- chore(deps): bump
scale family crates
,primitive-types
andimpl-serde
(#1832) - chore(deps): replace
instant
withweb-time
(#1830) - deps: use polkadot-sdk umbrella crate (#1786)
- stabilize reconnecting-rpc-client (#1803)
- stabilize chainhead backend (#1802)
- derive serialize on more types (#1797)
- use frame-decode for core extrinsic decode logic (including v5 support) (#1785)
- reconn-rpc-client: parse URL before connecting (#1789)
- update proc_macro_error to proc_macro_error2 (#1767)
- chore(deps): update Smoldot to the latest version (#1400)
- remove unneeded
?Sized
bound and replace never type with()
(#1758) - improve test coverage for legacy
Backend
impl (#1751) - add integration tests for
unstable-reconnecting-rpc-client
(#1711) - replace
reconnecting-jsonrpsee-ws-client
withsubxt-reconnecting-rpc-client
(#1705) - allow PartialExtrinsic to be held across await points (#1658)
- chore(deps): bump jsonrpsee from 0.22.5 to 0.23.1 (#1656)
Fixed
- fix stripping metadata in the case where enums like RuntimeCall are handed back (#1774)
- fix:
defalt-feature
->default-features
Cargo.toml (#1828) - avoid hang by notifying subscribers when the backend is closed (#1817)
- fix: error message on rpc errors (#1804)
- docs: fix typos (#1776)
- examples: fix reconnecting logging target (#1733)
- docs: fix spelling issues (#1699)
- chore: fix some comments (#1697)
- codegen: Fix decode error by adding
#[codec(dumb_trait_bound)]
(#1630)
v0.37.1
v0.37.0
[0.37.0] - 2024-05-28
This release mainly adds support for the sign extension CheckMetadataHash
and fixes a regression introduced in v0.36.0
where the type de-duplication was too aggressive and lots of the same type such as BoundedVec
was duplicated to
plenty of different types such as BoundedVec1, BoundedVec2, .. BoundedVec.
Added
- Implemented
sign_prehashed
forecdsa::Keypair
andeth::Keypair
(#1598) - Add a basic version of the CheckMetadataHash signed extension (#1590)
Changed
Full Changelog: v0.36.0...v0.37.0