Discarding json ptr deserialization for `config::Config`

[alibektas]

          Haven't looked at the split between local global and client yet. Will do that later. Additionally, one thing for a follow up we should look at is whether we can discard the json ptr deserialization approach now that the config structure is fully typed.

Originally posted by @Veykril in #16639 (comment)