NC | lifecycle | add notifications for lifecycle expire

[nadavMiz]

Describe the Problem

Explain the Changes

1. add notifications handling for nc lifecycle based on containerized lifecycle notifications handling
2. merged some of the notifications for lifecycle into notifications_util

Issues: Fixed #xxx / Gap #xxx

Testing Instructions:

manual testing:

1. create new bucket: s3api create-bucket --bucket test_bucket
2. create a new connection nb connection add --name conn --notification_protocol http
3. create notifications json:

{
    "TopicConfigurations": [
        {
            "Id": "notifications",
            "TopicArn": "conn",
            "Events": [
                "s3:LifecycleExpiration:Delete",
                "s3:LifecycleExpiration:DeleteMarkerCreated"
            ]
        }
    ]
}

4. add notifications configuration to the bucket: s3api put-bucket-notification-configuration --bucket test-bucket --notification-configuration file://notifications.json
5. create lifecycle policy. for example this policy delete all objects:

{
    "Rules": [
        {
            "ID": "Transition and Expiration Rule",
            "Status": "Enabled",
            "Filter": {
                "Prefix": ""
            },
            "Expiration": {
                "Date": "2022-07-12"
            }
        }
    ]
}

6. apply lifecycle policy to the bucket: s3api put-bucket-lifecycle-configuration --bucket test-bucket --lifecycle-configuration file://lifecycle.json
7. add objects to the bucket
8. run lifecycle cli: sudo node src/cmd/manage_nsfs lifecycle --disable_service_validation true --disable_runtime_validation true
9. delete notifications should be in the permanent log file. can be configured as env variable NOTIFICATION_LOG_DIR or set NOTIFICATION_LOG_DIR in config.js
10. to check notifications for delete marker, enable versioning on the bucket: s3api put-bucket-versioning --bucket test-bucket --versioning-configuration Status=Enabled, before running lifecycle

• Doc added/updated
• Tests added

[romayalon]

LGTM
added comments about minor things we talked about

[romayalon]

don't forget to move the _call_op_and_update_status() inside delete_objects_and_send_notifications()

[nadavMiz]

instead I created a function to send notifications and kept the delete function as it was before the change.

[romayalon]

don't forget merge logic with lifecycle.js

[nadavMiz]

@alphaprinz is currently modifying the lifecycle.js code. will leave it separate for now. we can merge it in a different PR