Point graph input and initializers back to the Graph. Use a tracked list for graph.input (and maybe output) to update the pointer.