Add OTLP and sampling to otelutils

[andrewwdye]

Why are the changes needed?

This changes adds support for OLTP and sampling to the otelutils tracer provider abstraction.

Adds support for OLTP. This is the recommended replacement for the deprecated jaeger exporter.

"go.opentelemetry.io/otel/exporters/jaeger" is deprecated: This module is no longer supported. OpenTelemetry dropped support for Jaeger exporter in July 2023. Jaeger officially accepts and recommends using OTLP

OLTP supports grpc and http, which are added as separate exporter types and configs.

Adds initial sampling support to the top level open telemetry config. Defaults to parent sampler always, but also adds a config for TraceIdRatioBased. See these docs for behavior of parent sampler.

How was this patch tested?

Ran local sandbox with local jaeger all-in-one and verified

• otlpgrpc with parent sampler always
• otlpgrpc with parent sampler traceid (along with other defaults)
• otlphttp with parent sampler traceid (along with other defaults)

Flyte config

❯ docker run --rm -e COLLECTOR_OTLP_ENABLED=true -p 16686:16686 -p 4317:4317 -p 4318:4318 jaegertracing/all-in-one:1.52

Jaeger

otel:
  type: otlpgrpc
  sampler:
    parentSampler: traceid

[codecov]

Codecov Report

Attention: Patch coverage is 45.94595% with 20 lines in your changes missing coverage. Please review.

Project coverage is 60.99%. Comparing base (2334d3f) to head (d504995).
Report is 128 commits behind head on master.

Files with missing lines	Patch %	Lines
flytestdlib/otelutils/factory.go	39.39%	20 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #5504      +/-   ##
==========================================
- Coverage   61.01%   60.99%   -0.02%     
==========================================
  Files         794      794              
  Lines       51441    51470      +29     
==========================================
+ Hits        31385    31395      +10     
- Misses      17164    17183      +19     
  Partials     2892     2892              

Flag	Coverage Δ
unittests-datacatalog	69.31% <ø> (ø)
unittests-flyteadmin	58.73% <ø> (ø)
unittests-flytecopilot	17.79% <ø> (ø)
unittests-flytectl	68.03% <ø> (ø)
unittests-flyteidl	79.04% <ø> (ø)
unittests-flyteplugins	61.85% <ø> (ø)
unittests-flytepropeller	57.30% <ø> (ø)
unittests-flytestdlib	65.59% <45.94%> (-0.23%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.