Bug: feat(config): update vector config



# Current Behaviour
- Sdk logs pushes `publishable_key` in the `merchant_id` field.
- open search logs have some irrelevant fields.

# Proposed Changes
- transform sdk logs and update the correct corresponding `merchant_id` of the pre-existing `publishable_key` value
- add some more except/ignore fields in open search sinks.
diff --git a/config/vector.yaml b/config/vector.yaml
index 3f0709ae03c..4b801935ae5 100644
--- a/config/vector.yaml
+++ b/config/vector.yaml
@@ -1,5 +1,16 @@
 acknowledgements:
   enabled: true
+enrichment_tables:
+  sdk_map:
+    type: file
+    file:
+      path: /etc/vector/config/sdk_map.csv
+      encoding:
+        type: csv
+    schema:
+      publishable_key: string
+      merchant_id: string
+
 
 api:
   enabled: true
@@ -87,6 +98,21 @@ transforms:
     key_field: "{{ .payment_id }}{{ .merchant_id }}"
     threshold: 1000
     window_secs: 60
+  
+  amend_sdk_logs:
+    type: remap
+    inputs:
+      - sdk_transformed
+    source: |
+      .before_transform = now()
+
+      merchant_id = .merchant_id
+      row = get_enrichment_table_record!("sdk_map", { "publishable_key" : merchant_id }, case_sensitive: true) 
+      .merchant_id = row.merchant_id
+
+      .after_transform = now()
+
+  
 
 sinks:
   opensearch_events_1:
@@ -110,6 +136,9 @@ sinks:
         - offset
         - partition
         - topic
+        - clickhouse_database
+        - last_synced
+        - sign_flag
     bulk:
       index: "vector-{{ .topic }}"
 
@@ -134,6 +163,9 @@ sinks:
         - offset
         - partition
         - topic
+        - clickhouse_database
+        - last_synced
+        - sign_flag
     bulk:
       # Add a date suffixed index for better grouping
       index: "vector-{{ .topic }}-%Y-%m-%d"
@@ -224,7 +256,7 @@ sinks:
         - "path"
         - "source_type"
     inputs:
-      - "sdk_transformed"
+      - "amend_sdk_logs"
     bootstrap_servers: kafka0:29092
     topic: hyper-sdk-logs
     key_field: ".merchant_id"

## Type of Change
<!-- Put an `x` in the boxes that apply -->

- [ ] Bugfix
- [x] New feature
- [x] Enhancement
- [ ] Refactoring
- [ ] Dependency updates
- [ ] Documentation
- [ ] CI/CD

## Fixes #6364  
 
## Description
<!-- Describe your changes in detail -->
- adding a transform for `sdk` logs that fetches a value from an enrichment table `sdk_map` populated by file `sdk_map.csv` and updates the fields using this value.
- adding some fields to ignore/except in `opensearch` logs sink
**Important Notes**
_Please ensure that the `sdk_map.csv` file is properly formatted and accessible at the specified path. The name of the file should also match the name of the table in config i.e `sdk_map`._
### Additional Changes

- [ ] This PR modifies the API contract
- [ ] This PR modifies the database schema
- [ ] This PR modifies application configuration/environment variables

<!--
Provide links to the files with corresponding changes.

Following are the paths where you can find config files:
1. `config`
-->


## Motivation and Context
<!--
Why is this change required? What problem does it solve?
If it fixes an open issue, please link to the issue here.

If you don't have an issue, we'd recommend starting with one first so the PR
can focus on the implementation (unless it is an obvious bug or documentation fix
that will have little conversation).
-->

### Prior Behaviour
- sdk logs have a merchant_id field but it was being populated with publishable_key as value at source
   observed `merchant_id: "pk_dev*****"`.
   expected `merchant_id: "merchant_*****"`.
- open search logs have certain fields like `last_synced`, `sign_flag` and `clickhouse_database` that needed to be ignored

### Intentions
- Ensuring correctness of logs and reduce log size by storing only relevant fields.

## How did you test it?
<!--
Did you write an integration/unit/API test to verify the code changes?
Or did you test this change manually (provide relevant screenshots)?
-->
### Running it locally to check logs added in console (sdk) logs & opensearch

#### sdk_logs
   I created a dummy_transform event that inserted a `publishable_key` in merchant_id field and passed it to the actual 
   transform function and then captured the output on a 
[console sink](https://vector.dev/docs/reference/configuration/sinks/console/console)
- test-code
<img width="1156" alt="Screenshot 2024-10-23 at 10 26 22 PM" src="https://github.com/user-attachments/assets/8f22c579-884f-4c65-8b09-aa657e87b261">

- sdk_map.csv (with dummy value 19999)
<img width="828" alt="Screenshot 2024-10-23 at 10 27 26 PM" src="https://github.com/user-attachments/assets/8e5bf34a-b082-451f-94c4-638178bd3e63">

- console output 
<img width="1390" alt="Screenshot 2024-10-23 at 10 25 40 PM" src="https://github.com/user-attachments/assets/b126978d-da7a-43b5-bcb4-512bfdf00afb">

#### opensearch logs

for this simply created a payment and compared the logs from kafka topics and opensearch entries

kafka ui
<img width="1726" alt="Screenshot 2024-10-23 at 10 44 45 PM" src="https://github.com/user-attachments/assets/6acfbb66-3d14-4156-9dc9-1d9d261331c7">

opensearch dashboard (no last_synced entry found)
<img width="1708" alt="Screenshot 2024-10-23 at 10 45 43 PM" src="https://github.com/user-attachments/assets/8574306d-4e85-4f79-9c3d-538c0f7aa7ca">

## Checklist
<!-- Put an `x` in the boxes that apply -->

- [ ] I formatted the code `cargo +nightly fmt --all`
- [ ] I addressed lints thrown by `cargo clippy`
- [ ] I reviewed the submitted code
- [ ] I added unit tests for my changes where possible