Add Kafka exporter and receiver configuration

[joeyyy09]

Which problem is this PR solving?

• Resolves [Jaeger v2] Add Kafka exporter and receiver #4868

Description of the changes

• Add config files for replacement of jaeger-collector and jaeger-ingester.
• Add the architecture for the integration tests for kafka.
• Add e2e integration tests for Kafka.

How was this change tested?

• Manually ran the collector, ingester configs to check if the data is being pushed and pulled the right way and verified the architecture.

Checklist

• I have read https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
• I have signed all commits
• I have added unit tests for the new functionality
• I have run lint and test steps successfully
  • for jaeger: make lint test
  • for jaeger-ui: yarn lint and yarn test

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.65%. Comparing base (813ff32) to head (4d4a882).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #5703      +/-   ##
==========================================
- Coverage   96.66%   96.65%   -0.02%     
==========================================
  Files         341      341              
  Lines       16451    16451              
==========================================
- Hits        15902    15900       -2     
- Misses        361      362       +1     
- Partials      188      189       +1     

Flag	Coverage Δ
badger_v1	8.05% <ø> (ø)
badger_v2	1.90% <ø> (ø)
cassandra-3.x-v1	16.61% <ø> (ø)
cassandra-3.x-v2	1.82% <ø> (ø)
cassandra-4.x-v1	16.61% <ø> (ø)
cassandra-4.x-v2	1.82% <ø> (ø)
elasticsearch-6.x-v1	18.77% <ø> (ø)
elasticsearch-7.x-v1	18.84% <ø> (ø)
elasticsearch-8.x-v1	19.03% <ø> (+0.01%)	⬆️
elasticsearch-8.x-v2	1.90% <ø> (+0.01%)	⬆️
grpc_v1	9.52% <ø> (+0.01%)	⬆️
grpc_v2	7.47% <ø> (ø)
kafka	9.74% <ø> (ø)
memory_v2	1.88% <ø> (-0.02%)	⬇️
opensearch-1.x-v1	18.89% <ø> (+0.01%)	⬆️
opensearch-2.x-v1	18.88% <ø> (-0.02%)	⬇️
opensearch-2.x-v2	1.90% <ø> (+0.01%)	⬆️
unittests	95.07% <ø> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[yurishkuro]

Lgtm, but we need e2e tests

[joeyyy09]

Lgtm, but we need e2e tests

Yeah, will get started on it!

[yurishkuro]

let's do this differently

• name the parameter such that its default value (false) works for almost every test, such that you only override it for Kafka
• define that parameter in the struct, not in the function. You can see above GetOperationsMissingSpanKind is an example of parameter that affects how the tests execute.

[joeyyy09]

okay will work on this

[joeyyy09]

Introduced a new parameter SkipStorageCleaner inside the E2EStorageIntegration which is by default false. So all the other tests work fine. We'll be overriding it only for the Kafka collector config so we that we dont inject the storage cleaner extension. I'd done this in my latest fix, let me know if this is fine