Skip to content

[OCTRL-1102] run dpl in k8s from ECS - #856

Open
justonedev1 wants to merge 8 commits into
masterfrom
run_dpl_presplit
Open

justonedev1 wants to merge 8 commits into
masterfrom
run_dpl_presplit

Conversation

@justonedev1

Copy link
Copy Markdown
Collaborator

to make ECS deploy dpl to k8s I did multiple things:

  1. port allocation: the port assignment was a step during Mesos task allocation. As we are using different path I created simple port allocator, that just starts at some predefined port number and return port that is one higher than previous. There are no checks whether the newly created port is free or not, as I wanted to keep it as simple as possible.
  2. dpl TaskTemplate: we are using common TaskTemplate for dpl tasks as they need similar requiremets to run.
  3. matching jitted template to the TaskTemplate and filling details. Every Jitted task is dpl, so I did simple string matching with regex.

knopers8
knopers8 previously approved these changes Sep 4, 2026

@knopers8 knopers8 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks! i won't have time to try it out before holidays, but will do after

Comment thread control-operator/ecs-manifests/task-templates/dpl-tasktemplate.yaml Outdated
@justonedev1
justonedev1 requested a review from knopers8 September 4, 2026 16:17
@knopers8 knopers8 changed the title run dpl in k8s from ECS [OCTRL-1102] run dpl in k8s from ECS Oct 7, 2026
knopers8
knopers8 previously approved these changes Oct 8, 2026

@knopers8 knopers8 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you!! i confirm it works also on my setup with no errors in the dataflow.

please merge according to your liking (squash or not)

@justonedev1
justonedev1 force-pushed the run_dpl_presplit branch 2 times, most recently from a53e72c to 80a8cc4 Compare October 19, 2026 16:25
@justonedev1

Copy link
Copy Markdown
Collaborator Author

sorry for making the review stale, I rebased on master, but there shouldn't be any new things in the PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants