-
Notifications
You must be signed in to change notification settings - Fork 25.4k
Add copy_from
option to the Append processor
#132003
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Add copy_from
option to the Append processor
#132003
Conversation
Pinging @elastic/es-data-management (Team:Data Management) |
Hi @chrisberkhout, I've created a changelog YAML for you. |
🔍 Preview links for changed docs |
d41a3fe
to
89568f5
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Happy to have this feature to avoid templating.
This change will also need an accompanying modification to the elasticsearch-specification to add the new parameter at https://github.com/elastic/elasticsearch-specification/blob/e585438d116b00ff34643179e6286e402c0bcaaf/specification/ingest/_types/Processors.ts#L329-L344
89568f5
to
55b8b34
Compare
Thanks. I opened a draft PR for it: elastic/elasticsearch-specification#5056 |
55b8b34
to
062a5c4
Compare
It mentioned 6 types, the full list is 15: Map, List, Set, byte[], double[][], double[], null, String, Integer, Long, Float, Double, Boolean, ZonedDateTime, Date.
062a5c4
to
726b6b9
Compare
Summary
A
copy_from
option for the Append processor, matching the option in the Set processor.This makes it possible to refer to existing non-String values.
Discussion
The alternative is to use a Script processor, which requires Painless code to manually initialize the destination field and to avoid duplicates if necessary.
One variation on this use case is here and in the following 7 script processors.
I'd be happy to add an
ignore_empty_value
option as well, which would make it easier to collect values that may exist in multiple locations into one destination.gradle check
? ✅If you are submitting this code for a class then read our policy for that.