Add observability test cases

[sutaakar]

Implement test cased covering CodeFlare operator observability.

Define metrics to be tracked, implement unit tests covering the metrics, adjust the e2e tests to cover relevant metrics.