Skip to content
This repository was archived by the owner on Feb 8, 2019. It is now read-only.

fix GEARPUMP-110, try streaming kmeans on Gearpump#5

Open
gy910210 wants to merge 1 commit into
apache:masterfrom
gy910210:kmeans
Open

fix GEARPUMP-110, try streaming kmeans on Gearpump#5
gy910210 wants to merge 1 commit into
apache:masterfrom
gy910210:kmeans

Conversation

@gy910210

Copy link
Copy Markdown
Contributor

No description provided.

@manuzhang

Copy link
Copy Markdown
Member

+1, Thanks.

previousNumber += currentNumber
currentNumber = 0
}
val newPoint = dataQueue.take()

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a blocking call. We suggest against block in Task. You may use "poll" instead.

@manuzhang

Copy link
Copy Markdown
Member

sorry, I was too optimistic previously. This example contains a cycle which cause the generation of process levels into dead loop. Please check https://github.com/apache/incubator-gearpump/blob/master/core/src/main/scala/io/gearpump/util/Graph.scala#L380

@gy910210

gy910210 commented May 3, 2016

Copy link
Copy Markdown
Contributor Author

@manuzhang Yes, I find that vertexHierarchyLevelMap() can cause dead loop if graph contains circle. But for topology sorting, the graph will call topologicalOrderWithCirclesIterator() if contains circle. So can we make vertexHierarchyLevelMap() possible to support circles in graph?

@manuzhang

Copy link
Copy Markdown
Member

Yes, please create a jira issue and open an PR if you've got a solution.

manuzhang added a commit to manuzhang/incubator-gearpump that referenced this pull request Jan 24, 2017
Author: manuzhang <owenzhang1990@gmail.com>

Closes apache#5 from manuzhang/upgrade.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants