feat(windows): Create daemon for non-k8s orchestration and update enricher, cache and controller to support standalone mode

[BeegiiK]

Description

This PR is part 1 of a POC on enabling Retina to work outside of Kubernetes (ACI) and collect pod level information such as name and namespace by running it as a binary on the host VM.

The two main efforts are the following:

• Decoupling the dependence for the K8s configuration files to allow bootstrapping to proceed. Currently, if the control plane fails to boot up, the data plane will also too. In the scenario of running on ACI, we need to reconfigure how Retina starts as it expects a lot of K8s information so that the responsible plugin (HNS stats - feature only supports windows as of now) can start collecting information. This behavior can be controlled by the new toggle, i.e. enableStandalone and by default it will be set to false.

• Collecting the pod related information. There are two ways that we can retrieve the pod name and its corresponding namespace for a given (HNS endpoint / IP address). Either through containerd or reading the CNI state file. This behavior can be controlled by another new toggle, i.e. enableCrictl. Once these were collected by the controller, the new data are returned in the new set of advanced metrics for windows

Bootstrap Manager:

• Retina would start as a normal binary with the toggle set to true in the config.yaml file. The bootstrap manager then selects the appropriate daemon depending if standalone is enabled.

Daemon:

• The new cache and the updated enricher is initialized and ran
• The new metrics module (feat(standalone): Create new metrics module that processes flows and update HNS plugin to emit relevant metrics #1859) is started and passed into the new controller and reconciliation begins during the lifetime of the process
• The controller manager is also started here (similar to the standard daemon) in order to start the http server and plugin manager

Controller:

• Depending on the toggle, the source is selected (implemented through the Source interface)
• Updates retina endpoints in the cache by checking the current running pods on the VM
• Deletes retina endpoints if the corresponding pod caches is no longer running
• The metrics module is also reconciled here to update the metrics ((feat(standalone): Create new metrics module that processes flows and update HNS plugin to emit relevant metrics #1859))

Enricher:

• For standalone mode, the HNS plugin will write to the enricher and flows will be handled here. The cache is checked for the corresponding IP address and enriched.
• The export reader of the enricher will be created in the metrics module.

Related Issue

#1365

Checklist

• I have read the contributing documentation.
• I signed and signed-off the commits (git commit -S -s ...). See this documentation on signing commits.
• I have correctly attributed the author(s) of the code.
• I have tested the changes locally.
• I have followed the project's style guidelines.
• I have updated the documentation, if necessary.
• I have added tests, if applicable.

Screenshots (if applicable) or Testing Completed

AKS testing to ensure normal Retina works

Running it as a binary on a Windows VM

CriCtl

State-file

Manual deletion in the state-file to reflect cache is updated

ACI Dev Node

Additional Notes

---

Please refer to the CONTRIBUTING.md file for more information on how to contribute to this project.

[Copilot]

PR Overview

This PR introduces a standalone daemon for non-K8s orchestration. Key changes include:

• Adding a standalone cache implementation with its corresponding test.
• Implementing a new standalone daemon in the cmd package.
• Introducing a BootstrapManager to initialize and start the daemon in non-Kubernetes environments.

Reviewed Changes

File	Description
pkg/controllers/cache/standalone_cache_test.go	Adds tests for standalone cache functionality
cmd/standalone_daemon.go	Implements a new standalone daemon for Retina orchestration
cmd/bootstrap_manager.go	Introduces a bootstrap manager to bootstrap the daemon
pkg/controllers/cache/standalone_cache.go	Implements cache logic used by the standalone daemon
cmd/standard/daemon.go	Updates daemon configuration and startup to integrate new behavior
cmd/root.go	Updates CLI to use the new BootstrapManager instead of the daemon directly

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

cmd/bootstrap_manager.go:43

• [nitpick] Consider using the logger for output instead of fmt.Printf to maintain consistent logging and potentially capture log levels and context.

fmt.Printf("Bootstrapping Retina")

[Copilot]

Copilot reviewed 20 out of 22 changed files in this pull request and generated 1 comment.

Files not reviewed (2)

• pkg/enricher/ctrinfo/mock_podSpec.json: Language not supported
• pkg/enricher/statefile/mock_statefile.json: Language not supported

[github-actions]

This PR will be closed in 7 days due to inactivity.

[github-actions]

Pull request closed due to inactivity.

[github-actions]

This PR will be closed in 7 days due to inactivity.

[github-actions]

Pull request closed due to inactivity.

[github-actions]

This PR will be closed in 7 days due to inactivity.

[github-actions]

Pull request closed due to inactivity.